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Abstract 

In this paper we introduce Law of Large Numbers and Central Limit Theorem 
for certain probabilistic system with estimated rate of convergence. The underlying 
probability space on which results are constructed is determined by the Entropy, 
which is a number of configurations of system which can occur for given state. 

The sample space is a lattice of rational numbers and represents the system states. 
Probability mass function of particular state is obtained by normalizing the En¬ 
tropy of considered state by the sum of Entropies of all states. The Entropy has a 
unique maximum for considered lattice and several other technical properties. As 
the system grows, i.e. its certain parameter increases, the Entropies increases and 
the lattice becomes denser. The first result of the paper gives the mean state as 
systems size tends to infinity. The second result, Central Limit Theorem, depends 
on the type of maximum of entropy. When maximum is in the interior of the lattice 
the fluctuation converges to Gaussian distribution. In case the maximum is on the 
boundary of the domain the distribution is a discrete in the direction orthogonal 
to the boundary of lattice on which maximum is situated and Gaussian in other 
directions. Additionally, for each result we provide the rate of convergence of the 
system to the resulting distribution. The proof consists of several approximations 
developed specially for this paper. The main are the Laplace type approximation 
but with sum instead of integrals and several other but rather standard approxi¬ 
mations. 

Key words — law of large numbers, central limit theorem, laplace approximation, 
entropy 

1 Introduction 

Limit theorems is a very rich and important branch of the probability theory. The Law 
of Large numbers and Central Limit theorems are among the fundaments of probabilistic 
theory and are essential in many probabilistic applications. In this paper we present a 
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new theoretical results for certain probabilistic system. 

The states of the system are represented as the nods on some finite lattice of ratio¬ 
nal numbers. For each nod, i.e. state, we are given an Entropy of the system, i.e. the 
number of configurations which system can take. The number of states and the Entropy 
depends on some parameter. As it increases the Entropy of the states increases and the 
lattice of states becomes more dense, i.e. the distances between nods become smaller. We 
can vaguely say that our probabilistic system increases as this parameter increase. The 
Entropy has a unique maximum on considered domain and for all value of parameter. 
Additionally Entropy has several others properties, rather technical in nature used in the 
proof. 

With this probabilistic system there is associated a formal probability space. The 
state space are the rational numbers which corresponds to the nodes of the lattice and 
there is associated with it a discrete sigma algebra. The probability measure, i.e. the 
probability of some set of states is just the sum exponents of the entropy of those states 
normalized by the sum of exponents of Entropies of all states. 

With the occurrence of certain state on the lattice, i.e. rational number, there is associ¬ 
ated a random variable. The first result is a Weak Law of Large number for this random 
variables. It gives us a single state to which system converges as the systems grows to 
infinity. This single state is one for which the Entropy has maximal value, and it can be 
called a mean. 

The second result is associated with the random variables which correspond to deviation 
from the mean obtained from previous result, multiplied by our increasing parameter to 
some power. It gives us the distribution of deviation of the system from the ’average’ 
state. For two types of maximum the Entropy we obtain different distributions. For the 
case when maximum is in the interior of the the lattice is we obtain a Gaussian distribu¬ 
tion. The second case is when the maximum is on the boundary of the lattice then we 
have a discrete distribution in direction orthogonal to boundary on which maximum is 
situated and Gaussian in other directions. 

The method of proving of both theorems is similar. We use the fact the weak con¬ 
vergence of random variable is implied by the convergence of the moment generating 
functions of this random variable. The moment generating functions are composed of 
sums of Entropies over all states in the denominator and with some additional factor 
also in the numerator. We developed a result for approximating those sums. E ssen tially, 
it is similar to Multivariate Laplace approximation introduced in Kolokoltsovi [2000] but 
is more complex, due to the summation instead of integration. Once the the sums are 
approximated, some minor additional approximations are needed but are rather stan¬ 
dard. Additionally, within the proof there is a special care taken to provide a rate of 
convergence of the system to given result. 

The paper consist of six sections and appendix. The second section of the paper intro¬ 
duces a mathematical setting on which the results are build on. We introduce the lattice, 
Entropy, its properties and prove its necessary properties. The probability space is also 
formally introduced. In the third section we introduce and prove our two limit theorems. 
The fourth section provides Laplace type results. There two results, one for each type of 
maximum of Entropy. In the next section we contained result used in the Laplace type 
approximation, its rather standard. It is a approximation of Gaussian integral with the 
sum. Finally, in the last section we put an additional estimate which are rather standard 
but developed specially for this paper. In the appendix we put relatively standard results 
used in the proofs. 
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2 Mathematical setting 


We consider a function S : x N — > R which has a unique maximum at the point 

x*(N), for every N > N 0 . In the limit, as N —» oo, the unique maximums tend to the 
point x*(N) -» x*. 

Let fl be some convex subset of M m . Then let us consider the lattice of the points 
x G R m separated by a distance jj, i.e. their components Xi, i,... , m takes values from 
the set {0, i, jk, -j|,...., 1, The domain of the function S, the set for 

considered N is a subset of that lattice such that it consists of the points contained in 
the subset fh 

Then we define a probability space. The domain Qjv is the sample space and the events 
given by rr’s are its points on the considered lattice. Further we define a m-dimensional 
discrete random vector Xn : Qjy —» R m with pmf 


P(X N = x ) 


e S(x,N) 

Sajv S( x , N ) ' 


( 1 ) 


Moreover, for the function S we consider two types of maximum 


a) Maximum inside the domain separated from the boundary by at least some constant 
distance in the limit as iV — y oo 


b) Maximum at the boundary for some N > N 0 and the point of maximum is not a 
critical. This boundary is a subset of a hyperplane in M m . The number v\ is the first 
component of v*(N) defined by Tv*(N ) = x*(N). Transformation T is rotation of 
coordinate system such that vf represents a distance form the origin to the boundary 
in appropriately rotated coordinate system is rational and . 

The function S(x,N), for large enough N is such that 


DS(x,N ) = h(N)[Ds(x) + a(x)e{N)}, 


( 2 ) 


where D is a differential operator and e(N) —> 0 as iV —> oo. Functions s and cr are C 2 
functions, are three times differentiable and matrix D 2 S is negative definite for all x G hi 
and some large enough N. Further the function h(N) = N or is such that 0. 

The resulting properties of the function S are given by the lemma 

Lemma 1 . For the function S we have constants s^ 2 \s'^ and s^ such that 


*< 2) = 


sup 

xgci n ,n>n 0 h{Jy) 


\D 2 S(x, 1V)|| < oo, 


(3) 


Since Hessian D 2 s(x) is invertible we have 

1 


s'W = inf 


and 


xen N ,N>N 0 h(N) 

1 


s ( 3 ) = sup 


D 2 S(x,N)- 1 \\~ 1 > 0, 
||L) lg)3 5'(a;, N)\\ < oo. 


xen N ,N>N 0 h(N) 

The point of maximum of S(x,N) is asymptotically equal to 


(4) 

(5) 


x*(N) =x* + 0{l)e(N), N oo 


( 6 ) 
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Proof. We start by proving the first result, ((3|). We calculate the second derivative of the 
representation of derivative vector DS given by (J2J) 

D 2 S(x, N) = h(N)[D 2 s(x) + Dcr(x)e(N)}, (7) 


where cr(x) is a vector where each component cooreponds to a component in vector x. 
Now we take the norm, apply triangle inequality and divide by h(N) and get 


1 

h(N) 


D 2 S(x,N)\\ < \\D 2 s(x)\\+e(N)\\Da(x)\\. 


Since the first expression is a constant for any x E and the second one tends to 0 as 
N —* oo, hence LHS is bounded for N > N 0 and x G fijv and therefore (J3j) is valid. 

Now, let us prove (J3J). We calculate the inverse of the second derivative D 2 S (ff|) 


I + D 2 s(x)~ 1 Da(x)e(N) , 

which is possible since D s is negative definite, hence invertible. 

Now we apply the asymptotic version of second result of the Theorem 5 from the Appendix 


D S(x, N) = 


D 2 s(x) 1 

h(N) 


(/ + eA)- 1 = I + 0(e), € —>■ 0, 


( 8 ) 


and obtain 


D 2 S(x,N)-' = ^hh|d[/ + 0(e(iV))], 


Then we take a norm, put expression in denominator and divide by h(N) 
1 


h(N) 


\D 2 S(x, N) 


—in—a 


HPMn-v+o( £ (iv) )]r\ 


and the apply Schwartz inequality and again result 
1 


h(N) 


\D 2 S(x,N) 


—l II—l 


> D z s x 


—i II —l i 


I + 0(e(N)) ||, 


Since first expression on the RHS is constant for all x G Qn and second is bounded for 
all N, hence LHS is bounded hence we get the final result. For the last result (J5]) we 
calculate the third derivatives tensor D® 3 S, take the norm, apply triangle inequality and 
divide by h(N) ad obtain 


1 

W) 


D 03 S(x,N)\\ < ||D® 3 s(a:)|| + e(iV)||£)V(a;)||. 


Again, since all the expressions on the RHS are bounded the LHS is also bounded for 
N > N 0 and x G Hat, hence we proved the result. 

We begin proving the last result for maximum of type a) with first order Taylor expansion 
of the vector DS(x*(N),N) at the point x* 


DS(x*(N),N) = DS(x*,N) + D 2 S(x 9l (N),N)(x*(N)-x*) (9) 


where x 9l (N) is some vector between x*(N ) and x*. Since x*(N) is a maximum of S(x, N ) 
and the maximum is of the type a) we have DS(x*(N), N) = o. Further, since x* is a 
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maximum in the limit hence using representation (J2J) linry^ 00 [.D,5'(a:*) + <j(;r*)e(lV)] = o 
we get DS(x*,N ) = h(N)a(x*)e(N). Then ([9]) is equivalent 

o = h(N)a(x*)e(N) + D 2 S(x ei (N), N)(x*(N) - x*) (10) 

and after taking absolute values and dividing by the norm of D 2 S 

\h{N)c{x*)e(N)\ = \\D 2 S(xo 1 (N), iV)|||x*(iV’) — x*\ 

and then we bound the norm using formula form appendix (1801) and property of S TP) 

\h(N)tj(x*)e(N)\ = ||Z) 2 S(£ ei (lV),lV)|||£*(lV) - x*\ > h(N)s ,( - 2) \x*(N) - x*\ 

hence finally we have a bound 

-J^\a{x*)e{N)\ > \x*(N) - x*\ 

which is valid for large enough N since we used representation (J2J) and is equivalent to 
the result when put in the big ’O’ notation. This was result for the maximum of type a). 
For the maximum of typa b) we have to perform the change of coordinates x — Tv first 
and than as previously use Taylor theorem 

DS(Tv*(N),N ) = DS(Tv*,N) + D 2 S(Tv ei (N),N)(Tv*(N)-Tv*) (11) 

Since the maximum is on the boundary, which is orthogonal to the direction iq, therefore 
i’l(N) = v\ is the same for all N in the vector v*(N). In other directions the maximum 
is varying and is in the point for which the first derivatives are equal to 0. Therefore 
the result (ns is the same for maximum of type b) with the difference that the vector 
h(N)a(x*)e(N) has first component equal to 0, i.e. 

where o~(x*) is a m — 1 dimensional vector. 

We have this 0 because the first derivatives in (fill) cancel out for the first component as 
v*(N ) = u*. Then we perform the same calculations as for the maximum type a) and 
the difference in the final result lays only in the constant hence asymptotic result is the 
same as for maximum of type a). □ 

3 Law of large numbers and corresponding fluctua¬ 
tions theorem 

Theorem 1 (Weak Law of large numbers). Let X^ be the m-dimensional discrete random 
vector on the sample space Qn with pmf specified by m- As N —» oo the random vector 
Xm converges in distribution to the constant vector x* = (x*, x %,..., x^) and we have 
following estimates, the same for both types of the maximum 

M x N (f) = et Tx * +°( /l(iV) 1 i/2-3^ when h(Ny/i-M >> e(iV) ’ 

m x n {£) = e ex * + 0(e(N)), when h ^ 1/2 _ 3S < e(N), 
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where 6 G (0,min{l/2m, 1/6}) is a constant, N —> oo, Mx N (f) is a moment generating 
function of the random vector X x - 

Proof. We prove the theorem by showing convergence of the moment generating f un ction 
of the random vector AW to a constant vector x* as N —* oo. 

The mgf of r.v. AW is equal 

MxAO = E[e? x }. 


Evaluating the probability mass function we obtain following expression for Mx N (C.) 


Mx(Z) 


e £, T x e S(x,N) 

En„ 


( 12 ) 


We start with approximating the first part of Mx N (C,), he the denominator for the two 
cases a) and b) using the Lemma 2 form the Section 2 


a) J2e S(x ’ N) 

f2jv 

b ) y eS{x ' N) 

Qjv 


N n 


,S(x*(N),N)_ 


(2t) 


m/2 


d 

N m ~ l 

d ' 


,S(x*(N),N) 


^J\ det D 2 S(x*(N), IV) | 
( 27r )(m- 1 )/ 2 


1 + 0 


\/| det D' 2 S(x*(N), 1V)| 


h(N) i/ 2 -3«5 

^ e ^S'( 3: *(7V),7V)i^ 1 + 0 /' 

7=n \ \ 


h(Ny/ 2 ~ 


where in this case the function g — 1 in the Lemma and we change the form of the 
estimates. Analogically we approximate the numerator of the mgf (fT21) . The additional 
function under the sums simply our function g in the estimates 


ATm 

a) > e ex+s{x ’ N) =_W T3 O j O + s ( x *( 7V )’ 7V ) 


■) w 


(2x) 


m/2 


CIn 


r e. T x+S(x,N) _ JV X t x*(N)+S(x*(N),N) 

d 


y|det0 2 S(x*(lV),lV)| 

( 27r )(m- 1 )/ 2 


1 + 0 


h(Ny/ 2 ~ 3S 


+ o( 

i =0 ' 


y/\ det D 2 S(x*(N), 1V)| 

1 


X 


h ( N y/2-36 J' 


Then we put together the approximations of the numerator and denominator of mgf 
using Lemma 7 from the Appendix, cancel the identical terms and for both types of 
maximum we have 


M XN (0 = e ext{N) [ 1 + 0 


h(Ny/ 2 ~ 3 y 


as N —» oo. 

Next we use following Taylor expansion 

e ex*{N) = e ex * + £ e £ T xg(N) ^ x * (jy) _ 


where xg(N ) is a point between x*(N) and x*. Then we substitute the estimate for 
x*(N) — x* © and obtain 

^W=^+^We(N), 


3 5 
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and we substitute it into (1T3|) and get an estimate 


MxAO = 


A 1 ** 


+ fid 


exg(N) 


<N) 


1 + 0 


h(N) 1 / 2-35 


hence we obtain two cases depending which term is asymptotically ’stronger’ e(N) or 
1 

h(N ) 1 / 2 - 35 


Mx N (£) = et x * + O 


h(N y/2-38j’ 


Mx n {£) = J x ’ + 0(e(N)), 


when 


when 


1-35 e (-^0> 


/r(lV) 1 / 2 - 35 

—35 ^ 


h(N)y 2 ~ 


where 5 G (0, min{l/2 m, 1/6}) is a constant and N —> oo 

□ 


For the discrete random vector on the sample space fbv with pmf specified by ([I]) 
we have a m-dimensional random vector Y N separately for the maximum of type a) and 
b) 

a) Y n = sMn)(X n -x*), 

b) Y n = N(V! - n}) + y/N{V - v*), (13) 


where x* and x* = Tv* = T(v*,v*) is the maximum of the functions S on The 
transformation x = Tv is a rotation of the coordinate system such that the axis V\ is 
orthogonal to the hyperplane of Hat on which maximum is attained. In the new coordinate 
system we have a transformed random vector Xn = TV = T(V\,V). 

Theorem 2 (Central Limit Theorem). As N — » oo and if e(N) <C l/y/h(N) from 
the representation fifty the defined above random vector Yn converges in distribution to a 
random vector with normal distribution A/"(0, D 2 s(x*)~ 1 ) for the maximum type a) and 
for the maximum of type b) to the mixture of normal distribution A/"(0, D 2 s(x*)^ 1 ) along 
variable V and discrete distribution with pmf )I w here i is an index of points 

in the coordinate V\ on the lattice T(Qn) starting form the maximal point v*. The matrix 
of derivatives D 2 .s(x *)~ 1 is m — 1 x m — 1 matrix along v^, i = 2,... ,m and s'(x*) is 
derivative of s along v\. The estimate is valid for a subsequence of integers N which 
elements can be divided by some integer q, where | = v* with v* = T~ l x*. Moreover, we 
assume that h{N) = N in the representation fifty of S for the second type of maximum. 
Furthermore, we have estimates 


a) + o( ft(jv) 1 , / ,_„ 

MyJt) = + 0(^h{N)e(N))\ 

V^°° 0 is'(x*)+£ii 

b) Myj ( ) = 

Z—/z=l c 

E oo As'(x*)+£ii „ A 

*=1 _ \£ t D 2 s{x*)- 1 £ 

Z— n=l ° 


1 + 0 


when e{N) <C 
when e(N) 
when e{N) -C 


h( N )l/2-3S 

l + 0(y/h(N)e(N)) ), when e(N) 3> 


h(Ny~ 3S ’ 

1 

^IV) 1 - 35 ’ 

1 

/i(iV)l-3«’ 

1 

1-35 ’ 


h(N) 
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as N —>• oo, where 5 6 (0, min{l/2m, 1/6}) zs some arbitrary small constant and My N is 
a moment generating function of random vector Y^- 


Proof. The proof is analogical to the prove of the previous theorem. We consider the 
moment generating function of the random vector Y/v 

MyAZ) = E++, 

and evaluating the probability mass function we obtain following expression for Ady N (tf) 

V p S(x,N) 


My N {i) = 


E a „e*wr 


(14) 


where S(x, N ) = S(x, N ) + f T Y N . Since the Y N are of the form (fTHI) the function S has 
the same properties as S. The corresponding representation ((2]) for S are given by 

a ) DS(x, N ) = h(N)[Ds(x) + a(x)S{N)], S(N) = e{N) + 


e(x) y/h(N) ’ 


b) DS(x,N ) = h(N)[Ds(x) + 5(N)}, 5(N) = e(N) + 


a(x 


)Vn 


, s'(x) = s'(x) + 1 


and for S two types of maximum are not altered. 

We first prove the result for the maximum of type a). We approximate the numerator 
and denominator of the mgf (ITT)) using Lemma 2 and combine them using Lemma 7. 
Then cancel identical terms and obtain 




Next we insert the estimate 


s(x*(n),n)-S(x*(n),n) V^det D 2 S(x*(N), N ) 


det D 2 S(x*(N),N) 
from Preposition 1 

1 \ 


1 + 0 


yv 1 / 2 —3<5 


Myjf) = e S<FmN)-S(x'(N),N) [l + 0 [ -j =j ) ( 1 + O 


TV 1 / 2 " 35 

and we simplify the estimate including only the ’strongest’ term as N —> oo 
M Yn (Z) = e S(**m")S(x*(N),N) I 1 + 0 I 1 


Nl/2-35 


Finally we substitute the estimate (155} from Preposition 1 

M r „«) = e ^ 5rDVl ' ) " £+ ° (1) vfe|l + 0 


jyl/2—35 


My n (Z) = f 1 + O 


when c(N) <C 


when e(N) > 


h{NY 

1 


jyi/2-3 SJJ v ' h{N)' 

Since the second terms in the exponent goes to 0 as N —* oo we can estimate 

0(1)- 1 i 


fh(Nj 


= 1 + 0 ( 1 )- 


VW)’ 

e O(l)y/h(N)e{N) = 1 + 0(l)y/h(N)e{N), 

























and we substitute that back into estimate and get 


1 


My„ (?) 

My n K) 


=e -^»-‘ t ( 1+0(1) ^)( 1+0 (_^)) 
= e -¥ TD2 ^r^ f i + 0(1) y/h(N)e{N)\(l + O ( 


7VV2-35 


when e(N) -C 


when e(N) > 


h(N) ’ 
1 

w 


and then simplifying the estimate and altering appropriately these cases we get the result 
of the theorem. 

For the maximum of type b) we perform similar calculations. Again, we approximate the 
numerator and denominator of the mgf (TT4|) using this time Lemma 3 and combine them 
using Lemma 7, cancel identical terms and obtain 


—' . N V°° \detD 2 S(x*(N), N) f 

IF\ = r S(x*(N),N)-S(x*(N),N) 2^i=l eN _* V_| ^ 4-D 

Si=i eJV ’ ^det D 2 S(x*(N),N) ' 

and then we use the results of the Preposition 1 to and obtain estimate 


Nl/2-35 




E oo 

i =1 


eN 


S'(x*(N),N)- 


e~* s '( x *( N) ’ N)i 

KO ° p jrS'(S*(N),N)- 


l _ e U T ^)-H 1 + Q 


h(N) 1 / 2 - 36 


when e(N) -C 


MyA£) = 6 ^'(l + O( VW)<N)) ), when e(JV) » 


E OO 

i=l e 


h(Ny- 3S ’ 

i 

h(N) 1 ~ 3S ’ 
(15) 


Next we use first order Taylor theorem for the function S > (x*(N),N) at x* 

S'(x*(N), N ) = S\x*, N ) + DS'(x 0 (N))(x*(N) - x*) 

Since the second derivatives DS' = DS' and because of (J3]) the norm of vector of second 
derivatives is also bounded ||Z? < S' / || < h(N)s^ 2 \ Hence we can write above estimate 
equation as 

\S'(x*{N),N)-S'(x*,N)\ < h(N)s^ 2 \\x*(N) - x*(N)\ + \x*(N) -x*\), 

and then we use estimate (J5]) and (152]) in the simplihcsd form and get 

| S'(x*(N),N) - S'(x *, N )| < h(iV)s (2) (A\|l/0E(iV)| + A' 2 |e(lV)|). 

Since we have assumption that e(N) -C we can write above as 

S\x*(N),N) = S'(x*,N)+0{l)y/h(N), 

and now we use the representation ([2]) of S 

S'{x*{N ), N) = h(N)(s'(x*) + 6 + ai(x*)e{N)) + 0{l)y/h{N), 

where we used explicit form of S and then again we use the assumption about e(N) and 
since h(N) = N for the maximum of type b) we finally obtain 

S'(x*(N), N ) = N(s'(x*) + 6) + 0(1)Vn. (16) 
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We analogically estimate S(x*(N), N) with few steps less and obtain 

S(x*(N), N ) = N(s'(x*) + 6) + 0(l)Ne(N). 

Then we put above estimate together with (HU as a sums as in (ED 
Em e (s '^* )+?l)i+0(1)(1 /^h Y^-i e (s ' (a: * )+?l)i (l + 0(l)(l/y/N)i) 

"" ^^1 e s'(a;*)j+o(i)e(w)i — Em e s 'W)*(l + 0(l)e(/V)i) 

and then we use Lemma 7 from the appendix and obtain the estimate 


E oo 
i =1 


e n 


S'(x*(N),N) ■ 


v°° / i 

^ =1 '1 + 0 ( 1 ) 


E°^i Em eOW)+?ih ^ 1 ~ 7 ’ 

Finally we insert above estimate into (TT71) and obtain 

V^°° „(s'(:r*)+£i)i / 1 \ 

Mr „«) = Sg 1 1 + 0(1)-L)e^ c, ^'>~‘t( 1 + 0 


V°° p ( s '(i*)+a)i 

L-ii =1 ' 

when e(N) <C ' 


\7]V 


^(TV) i/ 2 -35 


(17) 


h(N) 


1 - 35 ’ 


^»«)=(t+ + o(vm<N)) 

i 

when e(N) > 


h(N) 


1 - 35 ’ 


(18) 

(19) 


and once we simplify estimate by including only the ’strongest’ reminder term we get the 
final result. □ 


4 Partition function approximations 

First we introduce a differentiable function g : Qjy —> M such that 

sup \\Dg(x)\\ = g (1) < oo. 

Lemma 2. For defined above S(x,N) with the maximum of type a) 


^g(x)e s ^ 

Qjv 

K N m 

< 


N n 


d 


-g(x*(N))e s ^ N ^ 


(2tt) 


m/2 


|(/(**(JV))|e^**W- JV )- 


y/\ det D 2 S(x*(N), iV)| 
(27r) m / 2 


< 


( 20 ) 


n i/ 2-3S d yidetO^^^AT),^)!’ 

vallid for N > N 0 where 5 E (0, |) and d, K are some positive constants. 

Proof. We start by decomposing the initial sum into two. One within the sphere |x*(iV) — 
x\ < h ^ N y_/ 2 -6 and other one outside this sphere 


g(x)e s{x ’ N) = ^2g(x)t 


,S(x,N) 


5^(+>< 




n' 
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where fl' N represents the points in the domain inside the sphere and outside. Then 
for the first integral we expand function S with third order Taylor expansion at x*(N) 
and for the second integral we expand S with second order Taylor expansion and get 


E»<= swv) 


I.. , r':Vi, I li ■ !■ .V i: i + 

I 

^ g ( x yS(x*(N),N)+(x-x*(N))D 2 S(xe 2 (N) ,N)(x-x*(N )), 


O', 


where the first derivative vanish as x*(N) is a critical point of S. Then we expand the 
function g with first order Taylor approximation at x*(N) 


Y,9(x)e s ^> 

Ojv 


^2g^ x *^ N ^ e S(x*(N),N)+(x-x*)(N)D 2 S(x*(N),N)(x-x*(N))+D^S(xe im ,N)(x-x*(N))^ 3 + 

Tv 

+ J29(X0 3{ N)) T (X - x * N s j') e S ( x * N ’ N )+( x - x *)( N )D 2 S(x*{N),N)(x-x*(N)) x 


O'v 


( 21 ) 


x e D® 3 s(xg 1 ( jv) ,n)(x—x* (jv))® 3 _|_ 

( 22 ) 


Since the third order term of the expansion of S' consists of following expressions 

d dxidxfix k ^ Xi ~ x *( N M x i ~ X *A N ))( X * - x k( N )) 

and by the equivalence of the norm in finite dimensional space we have for the max norm 

1 


|Xi — x*(N)\K < max |x* — x*(N)\K < \x — £*(iV)| < 


h(N) 1 / 2 - 6 


hence 


Xi — x*(N ) = 


a 


h(N) i/ 2 - 5 

where cr is some constant. Since D 03 S by differentiating (J2J) is of order h(N), this implies 
by increasing N expression in (j3J) can be made arbitraty small. Therefore we can expand 
the exponent with the third derivatives of S in (Ell) 

e r>®3s ( * fllWl jv)(*-**(JV))®3 = x + o(D 03 S(x e ^N), N)(x - x*(N))® 3 ), as N oo, 

and we substitute it in (Ell) and after some transformations we get 

-E g ( x *( N ^ e S(x*(N),N)+{x-x*)(N)D 2 S(x*(N),N)(x-x*(N)) = 

Ujv n' N 

= g(x*(N))e s ( x *( N) ’ N)Hx - x *K N)D2s ( x * W ’ NKx - x * W) 0(D® 3 S{xe l{N) ,N)(x - x*(N))® 3 ) + 

+ Dg(xo 2 (N)) T (x - x *N)yS{x*{N),N)+{x-x*){N)D 3 S{x*{N),N){x-x*{N))+D^S{xe lW ,N){x-x*{N))^ + 

+ Yg{x)e s(x *( N) ’ N)+{x - x * W)D2sixe < 2 W,n){x-x*(n)) _ ( 23 ) 
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Now let us bound some expressions for above inequality. 

Since we assumed (JSJ), by the Shwarz inequality and properties of tensor product we have 
|B® 3 S(x 8l(K >,iV)(x-x*(]V))® 3 | < ||Z>® 3 5(xej(jv),JV)|||(x — x*(iV))® 3 | 

< ( 24 ) 

where we used Lemma 1 and the last bound is due to fact that we consider x G Vl' N , i.e. 
\X~X*(N)\ < h(N y /2 - S ■ 

Further, by (120T) and Schwarz inequality 

\Dg(x 0aW ) T (x - x*N))\ < g {l) \x - x*(N)\ < g (1) N y 2 _ s - (25) 

where the last bound is since we consider x G f 1' N . 

Since D 2 S is negative definite, by Schwartz inequality, assumption (j3J) and the inequality 
form appendix (180]) we have 

(x - x*(N)) T D 2 S(xe 2 ( N ), N)(x - x*(N)) = — |(a; — x*(N)) r D 2 S(x g ^ N) , N)(x - x*{N))\ < 

s - -w 2 k-* w < -Kvr*”. (26) 

where last inequality due to fact that we take x G Q!' N) i.e \x — (c*(iV)| > h ^ N ^ 1/2 - S ■ 

Now we take absolute value on both sides of (125|) and bound the RHS using (12Tj) . (125j) 
and (125]) 


J ^g(x)e s{x ’ N) - ^2g(x*{N))t 


,S(x*(N),N)+(x-x*(N)) t D 2 S(x*(N),N)(x-x*(N)) 


Ojv 


< 


< 


\g(x* (JV)) | e s(x * W’ N )+(x-x* (n)) t d 2 s(x*(n),n)( x -x* (jv)) Ks (z)^_L___ 

h(N) / 


E^ (1) 


1 e S(x*(N),N)+(x-x*(N)) T D 2 S(x*(N),N)(x-x*(N))+s ( 3 > h(jy)1 %_ 3i 


h(N) 1 / 2 ~ s 


E max \q(x)\e 

xeOjv 


S(x*(N),N)—h(N) 2S s'( 2 ) 


and then we perform some rearrangements of expressions 

S(x* ( N),N)+(x-x * ( N)) t D 2 S(x*(N),N)(x-x * (JV)) 


J2g( x ) eS{x,N) -^2g( x *(N))e- 


,S(x,N) 

U l «*/ I V. 

Ojv fl' N 

1 


< 


< 


^2 ^ ^ 1/2 3<5 1 g (x* (N )) | e S{x * (N>N)+(z-** ( n)) t d 2 s(x * ( jv ) ,n) (*-*• ( jv )) 


O' 


gW 1 

y L/Ar\2i5 


an (3) + 


h(Nf 


_jy^2<5 s , (^) 

rl! 


g(x*(N)) e( x - x *W rD2s ( x *W> N )( x ~ a 

(27) 


Then we perform further bounding, but concerning only the last expression in the bracket 
of RHS. First we bound its denominator. We use the Schwartz inequality and assumption 


:*(A0) 
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^^ e (x-x*(N)) T D 2 S(x*(N),N)(x-x*(N)) > ^ e ^||D 2 S(a:*(Ar),Ar)|||x-a:*(Ar)| 2 > 

O' o' 

^IV 

> ^2 e - h{N)s2lx ~ x * m2 > ^2 e ~ s2 > e_s(2) > (28) 


where in the second to last step we reduced the domain of sumation such that \x — x*| < 
h ^2)i/2 denoted as which was possible since all the summands are positive. In the last 
step we reduced sum to one point. 

Since the sum in the expression in the numerator does not depend on summed element, 
it is just number of elements in the sum. Therefore in can be bounded from above by the 
number of elements in the whole domain Qn,e- As this number is rather complicated to 
calucate we further bound the domain by the m — 1-dimensional hypercube of the edge 
size 1. Since the points are separated by the distance 1/TV in any directions there are 
(TV + l) m_1 of such points. Hence we have 

< (TV+ l) m -\ (29) 

into (1271) and further bound from above by 




Now we substitute estimates 
fixing TV in certain parts 




,S(x,N) 


'52g(x*(N)) t 


N 

and 


,S(x*(N),N)+{x-x*(N)) t D 2 S(x*(N),N){x-x*(N)) 


< 


< 


£ 


^ /r(TV) 1 / 2_3<5 


_| g ( x * (TV)) | e s{x * AO’AO+Oz-z* {n)) t d 2 s{x* (n) ,n) (x-x* (n)) 


Jis (3) + 


+ 9 


(i). 


s<3) 


HN 0 )V*-3* _|_ / l (^jV 0 ) 1/2 - 3(S (iV 0 + l) m ~ i maXj:gn;v l^^)l c -fe(A f o) 2 ^' (2) +^ (2) 


h(N) 2S 

and then denote expression in the bracket as A'o 


g(x*(N)) 


J2g(x)e S{x ’ N) - g(£*(TV))e 5(3: ‘ (iV )N) ^ e {x ~ x ^ N))TD2s{xt( ' N) ’ N){x ~ x * {N)) 


fi N 






^ AT 


o x-x*(N)y D 2 S(x*(N),N)(x-x*{N)) 


where the constant S G (0,1/6) in order to estimate be valid. 

The next step is to use the result of the Theorem 1 to estimate the sum with an integral. 
The volume of the grid size is equal to l/TV m as it is a hypercube fo dimension m with 
edges 1/TV, therefore the parameter d — 1. With appropriate calculations we get 


J2g( x ) eS{x ’ N) -N™g(x*(N))e s ^ N ^ \ e (*-x*m T D>s(x*(N),N)( x -x*m dx 

Ojv 

h(N) K 


in' 


< 


< N m 
+ N m 


TV /t(TV)( 1 / 2 - <5 )( m + 1 ) 

K 0 


\g(x*(N))\e s ^ N ^ 


1 + 


Kn 


h(TV) 1 / 2 


—3<5 


+ 


(30) 


/i(TV)!/ 2 3<5 


_ \g(x* (TV)) | e s< ~ x * (7V),7V) / e (*-z*(A WD 2 S(x*(N),N)(x-x*(N))' 
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Further we represent the integral in above inequality as 

[ e (.x-x*{N)) T D*S{x*{N),N){x-x*(N)) dx = 

Jn' N 

= f £ (x—x*(N)) t D 2 S(x*(N),N) (x—x* (N)) dx _|_ [ e {x-x*{N)) T D*S{x*{N),N)(x-x*{N)) dx 

r™ Js. m /n' N 

where the first integral we calculate using Lemma 1 from Analysis Appendix 

[ e (x-x*(N)) T D 2 S(x*(N),N)(x-x*(N)) dx = 

Jw N 

(2n) m / 2 


+ 


e (x-x * (N)Y D 2 S(x*(N),N) (x-x* (N)) dx 




VI detD 2 S(x*(N),N)\ 

We substitute above into (BUD and together with some manipulations get 

\m/2 


^V)e S(x ’ 7V) - N m g(x*(N)) P . S ( x *W’ N ^ — ( 27T ^ 


N 


y/\det D 2 S(x*(N))\ 


< 


< N r 


MN) 


I< 


N h(N)( 1 / 2 - s )(. m+1 '> 


\g(x*(N))\e Nf ^ N ^ 


1 + 


Ah 


h(N) 1 / 2 ~ 3S _ 


+ 


+ N m \g(x*(N))\e S ( X * W ’ N ) / e (x-x*(N)) T D 2 S(x*(N),N)(x-x*(N)) dx+ 


l /^'i V 


iw 


Ah 




(2tt 


\m/2 


h(Ny/ 2 ~ 3S 

e (x-x*(N)) T D 2 S(x*(N),N)(x-x*(N )) 

V^jv 


V|detA 2 S(x*(lV))| 


and we bound remaining integral in the inequality using Lemma 5 setting from the 
Analysis Appendix N = h(N ) and A = D 2 S/h(N) 


J2g(x)e s(x ’ N) - N m g(x*(N))e s{x ^ N) ’ N) 


(2tt 


\m/2 


£2 A 


V|detD 2 S'(a;*(iV))| 


< N 7 


MN) 


K 


N h(N) (!/ 2 -5)(^+i) 

+ N m e~ h{N)2d |g (x* (N )) | e 5(a: * (iV) ’ 7V) 


|V^(A^))|e S(a: * (JV) ’ JV) 


1 + 


< 


Ah 


/l(N)V2-3« 


+ 


7T 2 


1 ^1 +Vl + 4h(A^)- 1+2,5 V n_i , r(m 

X M n ) V 2 1 + 


h(N) m / 2 y/\ det D 2 S(x*(N),N)\T( 

m— 1 


■X 


+ Nm r , >ni°/o_^ 


(2vr) m / 2 


1 + 


Ah 


/i(AT)V2-35 


+ 


h(Ny/ 2 ~ 3S y v a/I det A 2 S'(a;*(A^))| ’ 

and the last term is asymptotically ’strongest’. Let us bound the above expression by 
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fixing N = Nq in some expresions and introduce constants 


(2tt) 


m/2 


y"g(x)e s ^ x ’ N) - N m g(x*(N))e s{ - x * (N) ’ N) ^ _ 

t: V\detD 2 S(x*(N),N)\ 


< 


< 


h(N) 1 / 2 - 36 

K 


—N m \g(x*(N))\e s ^ x ^ N) ' N) 


(2vr; 


im/2 


y/|detA 2 S(a;*(lV),lV)| 


K 0 + 


h(N 0 ) y/\ det D 2 S(x*(N), A r )| 


/l(iY 0 )( 1 /2-5)m+25 N() 


1 + 


An 


1/2-36 „-h(N 0 ) 2S 71 2 

r (f) 


h(N 0 r'“ "“e 


A(iV c 


/i(A' 0 ) 1 / 2-36 
m—1 


+ 


(27 r ) m / 2 

1 /! + Vl + 4/i(A r o)- 1+2,5 ^ m ” i r(m) 


h{N 0 


1 + 


Ah 


h(N 0 y/ 2 ~ 


Hence, finally we have 


(2vr; 


,m/2 


V^(a:)e s(x A) _ JV m ^(a;*(7V))e s ( a! * (JV )- iV) —=_ 

tZ VI det D 2 S(x*(N). TV)| 


< 


< 


A'' 


^(TV) 1/2-36 




(27T 


|?7l/2 


a/| det A 2 S'(x*(A^), iV)| 


where K' > 0 is some constant. To ensure the validity of the estimate for we have a 
condition 5 G (0,1/6). Therefore we get the result for the first case of the maximum. 


□ 


Lemma 3. For defined above S(x,N ) and the maximum of type b) 

S(Tv,N) _ 


jym-l 


J2 g(Tv)e st - n ' N > - - - g(Tv"(N)) e stTv ‘ (N ^ ) J2 ei,S ' tTV ‘ iNm ' 


(2*r)< 


m— 1)/2 


r(n N ) 


i =0 


y/| det D 2 S(Tv*(N), iV)| 

( 2 7 r )( m - 1 )/2 


< 


r' ™-1 00 

< yn/-|„( rt ,.( Af ))| e S(T»-W.A')W e *S'(T»-TO.A')i^_ 

t/ y|det£>2S(T«*(JV),JV)|’ 


JV1/2-3J d 


(31) 


where 5 G (0, min{l/2 m, 1/6}), d and K are some positive constants. The transformation 
x — Tv is a rotation of the coordinate system such that the axis v\ is orthogonal to the 
hyperplane of Ft^ on which maximum is attained. The matrix of derivatives D 2 f(Tv*(N )) 
is m — 1 x m — 1 matrix along v^, i = 2,... ,m and s' is derivative of s along V\. The 
estimate is valid for a subsequence of integers N which elements can be divided by some 
integer q, where | = v* with v* = T _1 x*. Further, we assume that h(N ) = N in the 
representation |IJ) of S. 

Proof. We start with performing a rotation of the coordinate system x — Tv in the way 
that axis of V\ is orthogonal to the hyperplane which the maximum is attained and points 
of V\ in the domain are increasing 

J2g(x)e s ^= g(Tv)e s ^ N \ 

&N T(Qat) 

Corresponding points of the domain of summation Qjy are also rotated and we denote the 
rotated points of the domain as T(FIn). The maximum in the new coordinates will be 


36 
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denoted by v*(N). In the next step we decompose the sum into two. First one with points 
contained in the cylinder defined by two constraints. One along v\ , |t’i — i;*(jV)| < 
and the second along coordinates from v 2 ,... ,v m denoted by v, \v — D*(jV)| < h ^ N y /2 _ s . 
This cylinder is denoted by T(Q^)'. The second sum is simply over remaining points and 
we denote it by T(Qn)" 

Y 9 (Tv)e s ^ = Y 9( T v)e S{Tv ’ N) + Y g{Tv)e s ^ N \ 

T{SI N ) T(ci N y T( n N y 

Then we expand function S into Taylor series, third order in the first sum and second in 
the second one 


£ 9{Tv)e «OVO = V g{Tv)e s{ - Tv * ( N )’ N )+ s '(. Tv * 00,AO hi -*>* (N))+(y-v* ( n)) t d 2 s(Tv * (n),n)(v-v* (n)) x 
t(q n ) T(n N y 

x e D® 3 S(T« 6l(lv) ,JV)(»-«*(JV))® 3 + 

+ ^2 g(Tv)e S ( Tv *( N) ’ N)+S ' {Tv *( N) ’ N ' >iv i-Vi( N ))+(v-v*(N)) T D 2 S(Tv e2(N) ,N)(v-v*(N))^ 
t{ n N y> 


where the first the derivative S' is along v\. Note that first derivatives along the coordi¬ 
nates v are equal to 0 since we expand in Taylor series at the maximum. 

Next we expand into Taylor series of first order at v*(N) function g and get 


Y g{Tv)e s ^ = Y g(Tv*(N))e 


S(Tv* (N),N)+S'{Tv* (N),N)( Vl -«* (N))+(v-v* ( N)) t D 2 S(Tv* (N),N)(v-v* (N)) 


X 


T(n N ) T(n N y 

x e D® 3 S(Tvg l(N) ,N)(v-v*(N ))® 3 + 

+ Y D g( Tv 03(N)) T (.V - v *(^N^ e S(Tv*(N),N)+S'(Tv*(N), N )(v 1 - V * 1 (N))+(v-v*(N)) TD2 f(Tv*(N),N)(v-v*( N )) x 

T(n N y 

x e D® 3 S(Tv ei(N) ,N)(v-v*(N ))® 3 + 

+ Y g(Tv)e S ( Tv *( N ' ),N ' )+S '( Tv *( N ' ) ’ N ^ V1 - V l ( N ))+( v ~ v * ( N )) T D2s (. Tv e 2 (N),N)(v-v* (N)). ( 32 ) 

T(Q n , b )" 


Since the third order term of the expansion of S consists of following expressions 

&S{Tv hW ) 


(Vi ~ <(N))( Vj - v-AN))(v t - vl(N)) 


(33) 


dvidvjdvk 

and by the equivalence of the norm in finite dimensional space we have for the max norm 

1 


|Vi - v*(N)\K < max \v t - v*{N)\K < \v - v*(N)\ < 


h(Ny/ 2 ~ s 


hence 


Vi-vUN) 


a 

h{N) i/ 2 "- 5 


(34) 


where a is some constant. Since D® 3 S by differentiating (J2]) is of order h(N). This 
implies that for N > N 0 expression in (1551) can be made arbitrary small. Therefore we 
can expand the exponent with the third derivatives of S in (1521) 


e D® 3 s(Tv ei{N) )(v-v*m ®3 = x + o(D ea S{Tvg liN) )(v - v*(N))® 3 ), as N oo, (35) 
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and we substitute it back to (l32]h and after some rearrangements 

£ S,(Tv)e^ - V g (^Tv* (N))e s ^ Tv * < ' N ' ) ’ N ' )+S ' ( - Tv * - v i( N ))+( v ~ v * ( N )) r d2 s ( Tv * ( N )’ N )( V ~ V * ( N )) 

t(Qjv) T(n N y 

= Y g(Tv*(N))e s{Tv * ( n ), n )+s , (Tv*{n),n){v 1 -vI{n))+{v-v*{n)) t d 2 s{Tv*{n),n){v-v*(n)) x 


T(n N y 

x 0(D® 3 S(Tv ei{N) ,N)(v - v*(N))® 3 ) + 

+ Y D 9( Tv e 3 (N)) T (v - v *(^N^ e S(,Tv*{N),N)+ s '{Tv*( N ),N)( v 1 - v l(N))+( v - v *(N)) TD2 S(Tv*(N), N ){ v -v*(N)) x 


T(n N y 


x (l + O ( D® 3 S(Tv 6liN) , N) (v - V* (N))® 3 )) + 


Y ^(^n)e S(T,; ‘ (Ar) ’ iV)+5 ' (T^, * (7V) ’ 7V)(,;l ~ ,, *i( N ))+(v-v* (N)) T D2s {Tve 2(N) ,N){ v -v*(N)) _ ( 36 ) 

t{ n N y> 


Now let us bound some expressions for above inequality. 

Since we assumed (JSJ), by the Schwartz inequality, properties of tensor product and equiv¬ 
alence of norms we have 


\D® 3 S(Tv dlW ,N)(v-v*(N)f 3 \ < || J D® 3 > S(rn 0l(7 v ) )|||(u-rd(iV))® 3 | < 

1 


< h(N)s {3) \v - u*(iV)| 3 < s (3) /r(iV)( max |Vi — v*\) 3 < s 


(3). 


h(N) 1 / 2 - 36 ’ 


(37) 


where the last bound is due to fact that we consider v G T(fi at)', i.e. \v — h*(iV)| < 
fe(Af) 1 i/ 2 -^- and dSD is valid. 

Further, by (12(71) and Schwartz inequality 


\Dg(Tve 3{N )) T (v - v*N))\ < g (1) \v - v*(N)\ < g (1) 


h(N) 1 / 2 - 5 ' 


(38) 


where the last bound is since we consider v G T(Q N )'. 

Since D 2 S(Tvg 2 (N), N) is negative definite, by Schwarz inequality and assumption ((4j) 


v - v*(N)Y D z S{Tve 2 {N)i N)(v - v*(N)) =-\(v - v*(N)Y D 2 S(Tv e2{N) , N)(v - v*(N))\ < 
1 ^r\v-v*(N)\ 2 <-h(NY s s ,( - 2 \ (39) 


< 


IP^r^pv), AO- 


where last inequality due to fact that we take v G T(Qn)", i.e \v — u*(iV)| > h ^ N y/ 2 ~s ■ 
Next, we take absolute value on both sides of (13(H) . apply triangle inequality on the RHS 
amd use estimates d3ZD, <m and (j39j) 


£ g(Tv)e s ( Tv,N ' ) - £ g(Tv'(N))e 


S(Tv*(N),N)+S’(Tv*(N),N)(vi-v1(N))+(v-v*(N)) t D 2 S(Tv*(N),N)(v-v*(N)) 


T(n N ) 
< 


T(n N y 


Y I g(Tv* ( JV) ) | e Nf( - Tv * ( N )’ N )+ N f( Tv * (JV),2V)(«i -R {N))+N(v-v* ( N)) T D 2 f{Tv * {N),N){v-v* {N)) Ks ( 3) ^ 2 3 

YO.rV ^N) ^ 


T(n jv ) 


E 


,(i). 


S(Tv*{N),N)+S'{Tv*(N),N)( V1 -vt(N))+( V -v*(N)) T D 2 S(Tv*(N),N)(v-v*(N))+s^ ^1/2-36 + 


T{a N ) 

£ 

T{ n N ) 


Y h(Ny/ 2 ~ s 

S(Tv*{N),N)+S'{Tv*{N),N)(v 1 -vl{N))-h{N) 2S s'( 2 '> 


Y \g( Tv ^ e ' 
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and then we perform some rearrangements of expressions 


Y g(Tv)e s{ - Tv ^ 

T(p. N ) 


g(J^ v *(^]\[^ e S(Tv*(N),N)+S'(Tv*(N),N)(vi-vl(N))+(y-v* (N)) T D 2 S(Tv*(N),N)(y-v* (N)) 

T(n N y 


< 


^ h(Ny/ 2 ~ 3S 
T(Q N y y ’ 


\ g ^T v yN))\e s(Tv * {NlN)+s ' (Tv ^ N) ' N){vi ~ v * iN))Hv ~ vt{N))TD2s{Tv ^ N) ’ NKv ~ vHN)) x 


x 


x 


Ks® + ^d)_L_ e s(3 \ (J v)i%-3. + h ( N y/ 2 - 36 ma *venn N )\g(Tv)\ * 


h(Nf 


g(Tv*(N)) 


E 


T(n N )>‘ 


0 -h(N) 25 s'( 2 ) 


V f> S'(Tv*(N),N)(vi-vUN))+(v-v*(N)) T D 2 S(Tv*(N),N)(v-v*(N)) 

^T(p N y e 


(40) 


Then we perform further bounding, but concerning only the last expression in the bracket 
of RHS. First we bound its denominator. We use the Schwartz inequality and assumption 

© 


e S'(Tv*(N),N)(v 1 -v*(N))+(v-v*(N)) T D 2 S(Tv*(N),N)(v-v*(N)) > 

T(n N y 

g—| S'(Tv* (N),N )\|*ui —(JV) | —\\D 2 S(Tv* (N),N) || |u—-u* (iV) | 2 > 

T(p N y 

y^ g—|S ,, (Tu*(J\q,iV)||t)i— (N)\—h(N)s 2 \v—v*(N)\ 2 > y^ g-|S'(T4;*(W),W)|/h(Ar)-s 2 > g-|5 , (Ti)'*(W),Af)|/h(Ar)-F( 2 ) 
T(CIn)' T(Q N y" 

(41) 

where in the second to last step we reduced the domain of summation such that \v — v*\ < 
fe( .y i/2 and |ni — vl(N)\ < denoted as T(Qn)"' which was possible since all the 
summands are positive. In the last step we reduced sum to one point. 

Since the sum in the expression in the numerator does not depend on summed element, 
it is just number of elements in the sum. Therefore in can be bounded from above by the 
number of elements in the whole domain T(Qn). As this number is rather complicated 
to calculate we further bound the domain by the m -dimensional hypercube of edge size 1. 

Since the points are separated by the distance 1/N in any directions there are (.N + l) m 
of such points. Hence we have 


Y l<(iV + l) m (42) 

T(n N y 

Now we substitute estimates (HO and (142|) into (140!) and further bound from above by 
fixing N 


£ S (Tv)e^ - V g (Tv* (N))e s{Tv * ( n),n)+s’(t v * {n),n)( Vi -vI (n))+(v-v* ( n)) t d 2 s(Tv * {n),n){v-v* (n)) 
T(Q n ) T(Q n )' 

< y^ Y^—^\g(Tv*(N))\e s ( Tv *( N ' ) ’ N ' )+s '( Tv * < ' N ' >,N ' > ( vl ~ v i( N ^ + ( v - v *( N )) Td2s ( Tv *( n )’ N )( v ~ v *( n )) x 


h ( N y/2-36' 

T(n N y y ’ 

1 (3) 

Ks (3) + 9 {l) T7TKT8 eS HNo)1/ ^ + 


h(N) 


7 , ( AT M/2—35 I AT , \g(Tv)\ ~_ h(N<)) 25 s , ( 2) +s (2) 

h{No) {N ° + 1} - g(Tv*(N)) - 6 
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and denoting expression in the bracket as K' 


g(Tv)e S{Tv ’ N) - g(Tv*(N))e S{Tv * {N) ’ N) ^ e S'{Tv*(N),N){v 1 -v* 1 (N))+(v-v*(N)) T D 2 S(Tv*(N),N)(v-v*(N)) 

n a N ) T(n N y 

— |g(rt'*(AQ)|c s(T,, * (JV),JV ) ^2 e s,(T ^ ( ^ ) ’^ )(w_ ^ ( ^ ))+( ^‘ ( ^ ))TD25(T ^ ( ^ ) ’^ )(,,_,, * (7V)) , 
h<yN ^ 1 T(n N y 

(43) 


< 


where the constant <5 6 (0,1/6) in order to estimate be valid. 

Then we perform further estimates. We start we following decomposition of the second 
expression in the exponent of the sums 


(» - v-(N)) t D 2 S(Tv'(N), N)(v - v*(N)) = £ <> ’ S( /'l/ ) ’ iV) (”i - <(JV))(Bj - w-(AO) = 

*J=1 * 3 

^ &S(Tv*(N),N), * /Ar ... * /aA . ^3 2 S(Tu*(A 0 ; A0, t/#nw 


2 

m—1 


^d 2 S(Tv'(N),N), d 2 S(Tv*(N), N) 

E EE. fa - WX”! - W) + E. L (»'■ - <( iv ))(«i - •’IW)' 


Z=1 


dvidv i 


dv\dv\ 


Now as taking into account (1341) and fact that (wi — ^(IV)) = h ^is hr the considered 
domain, we can estimate above 


(«- s(n)) t d 2 s(tv'(n), iv)( V - v*(n)) = "f; d ~ st l"'fo ),N \ n - vnmn - gm = 

^ .7 


m=i 


= (t) - u*(7V)) J D 2 S(Tv*(N), N)(v - D*(1V)) + 
cr'cr 

2-2(5 rhkfhu + 

3 = 1 


h(lV)3/2-25 [_ 2^ 


y. 1 &S{Tv*{N), iV) ™ 1 «9 2 S(7V(1V), AT) 

E —t fhifhu 


dvidvj 


+ 


a'a d 2 S(Tv*(N),N ) 


/i(7V) 


2-25 


dvidvi 


where D represents differentiation operator along vector (t’ 2 , t’m-i)- Since the second 
derivative of S' represented by (j2]) is of order h(N) the last two terms in the above 
estimate are tending to 0 as N —» oo and we can expand the exponent of this estimate 
in following way 


Jv—0* ( N)) t D 2 S(Tv* (N),N)(v-v* (N)) v 
c- A 


x e 


h(N) 3 / 2 ~ 2S 


m—1 d 2 S(Tv*(N),N) , y^m-1 d 2 S(Tv* (N) ,N) 


E m— 

i= 1 


i vm —l 

-h 


V-^OVj 


cr'cr d 2 S(Tv* (N) ,N) 

h(N) 2 - 2d dv 1 dv 1 


= e (v-v*(N)) T D 2 S(Tv*(N),N)(v-v*(N)) ( 1 + 


cr'cr 


= e (v-v*(N)) T D 2 S(Tv*(N),N)(v-v*(N)) I + ^ 


/z(iV) 1 /2-2<5 


h(Ny/ 2 ~ 2S J ’ 


1 + ^2 


h(lV) 


1-2(5 


where A'i and AE are some constants and 


1 , K.o'oIU 

Iu ~ aa + Ii2 w^ 
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Then we substitute above estimate into (I43H . perform some manipulations and obtain 


e S'(Tv* (TV),TV)(m-v* (N))+(£)-v* ( N)) t D 2 S(Tv* (N),N)(v-v* (TV)) 

T(n N ) T(n N y 

K" 


< 


h(N) 1/2-35 




S(7V (TV),TV) ^S'(Tv* (N),N)(v i (TV))+(u—0* ( N)) t D 2 S(Tv* (N),N)(v—v* (TV)) 

T(n N y 

(44) 


where 


A'" = K' + A' 4 


h(N 0 y 


+ K'lU 


h(N o y/ 2 ~ 2S ' 

Further, since the hyperplane on which is the maximum is orthogonal to axis V\ , all the 
points of the domain T(Q,^)' can represented as a series of hyperplanes, instead of one 
lattice. Since the coeficients of the hyperplane on which maximum is are rational the 
points on each such hyperplane form a lattice and each such lattice is composed of the 
ponits of T(h2jv)' which has a fixed coordinate of v\. In the next step we reexpress the 
sum in the estimate (1441) 

E = E E 

T(ci N y vieT(n N yT(n N y( Vl ) 

which means that we first sum over coordinate V\ and then for a fixed V\ we sum over 
the points of T(Q, N )'. 

We insert it into (1T4D and perform some rearreagements 


£ g(Tv)e s ^ - g(Tv*(N))e s ^ Tv * (JV),JV) £ e s ^ Tv *^ N ^- v ^ x 

T(fl N ) vi£T(fl N )' 


x ]T e 


(■ v-v* (N)) t D 2 S(Tv* (N),N)(v—v* (TV)) 


< 


T(njv)'(^i) 

K" 


< 




x E e 
T(a N y( Vl ) 


vieT(Q N y 

(v-v*(N)) t D 2 S(Tv*(N),N)(v-v*(N)) 


Now we perform approximation with the integral the last sum in the RHS and LHS. We 
do this step in the same way as for the previous case of maximum. The difference lies in 
in the dimension, its one less and with the structure of the grid, it might not be a regular 
hypercubes, therefore the parameter d / 1. After appropriate calculations we get 


E s( Tv > 


,S(Tv,N) 


T(CI N ) 


X 


< 


X 




d 

m- 1)/2 


-g(Tv\N))e s ^ N ^ E e S'(Tv*(N),N)(v 1 -v* 1 (N)) x 

■uiGT(Ojv)' 


< 


y/\ det D 2 S(Tv*(N),N)\ 

^ ’ DieT(njv)' 




m-l)/2 


a/| det D 2 S(Tv*(N), iV)| ’ 


(45) 
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where K'" > 0 and d > 0 are some constants. Note, that as previously, to ensure the 
validity of the estimate we have a condition 5 G (0,1/6). Now, let us represent v\ = 
i = 0,..., In, where In corresponds to the last point within T(Qn)' and A; is a positive 
integer such that k = . In this notation integer i represents the number of the point 

from the boundary where is the maximum r). Further we represent i;* — V\ — + <p(N). 

The constant ip(N) = Nv i~t Nv ii w hich is the distance form the maximum to the nearest 
point on the lattice on the axis v±. Note that the constant Nip(N) for oscillates on the 
interval [0,1] for various values of N. From the assumptions we have that v\ is a rational, 
i.e. V\ = | for some integers p, q and q is a divisor of N hence Nv* = |_Nu*J hence the 
constant ip(N) = 0. Therefore we can represent the sum in (j49l) as 

In 

e s' ( Tv* (N) ,N) {vi-vt (N)) = e JT s ' ( Tv * WM , (46) 

diST(Qjv)' 2=0 

for a appropriate subsequence of N. Further, we can represnt the sum of above expression 
as a difference 



In 

J2 e W S '(Tv*(N),N)i = 
2=0 


E 

2=0 


qN S' (Tv* (N) ,N)i 


oo 

E 1 

In 


CN 


-I S'(Tv* (N),N)i 


(47) 


Since In corresponds to biggest possible element Vi within T(Qn)', he. within |tq — 
v*| < N~ 1+s hence elements larger than In corresponds to values of v\ in the interval 
|r>i — > N~ 1+s or equivalently i > N 5 . Therefore one can estimate the second sum in 

the RHS of (J3J) 


E 


e ±S'(Tv*(N),N)i = 


^2 e jfS'(Tv*(N),N)i < 
i>N s 

I. Qfi r r n ,* (at\ at\atS ioh 

>oo 


(48) 


< / e ^S , (T»-(K),»), (iw + e iS'(T«*(K),K)W‘ _ li m e W S 'P’«'*W,»)« j 

Jn s 


where the last estimate is due to standard approximation of sum with an integral. 

Since S' due to representation (J2J) is of order h(N) and we assumed that h(N) = N the 
above estimate can be simplified and the integral calculated 

_ _ 1 _p-| s l( a: )+‘7lb ; M Ar )l Ar ' 5 _i_ p-bi(a:)+o-l(*)d Ar )l Ar ' 5 

S ' 1 (x) + ( j 1 (x)e(7V) 


where the S' expression in the exponent is negative since S' was negative. 

Hence putting together above estimate with (1461) , (147)1 and (148]) and adding absolute value 
appropriately one after some calculations gets 


E 


,S'(Tv*(l V),N)(v!-v1(N)) 


vi gT(Ojv)' 


2 = 0 


e jfS'(Tv* 


(. N),N)i 


< J{ ie ~\ s i(x)+°i{xM N )\ NS 


where K x = sup x ^,N>N 0 ( s ' l{x)+a \ (xH N) + X )- 
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Finally, we substitute above estimate into (149]) and perform some calculations to obtain 


]T g(Tv)e s ^ - I l^-g(Tv*(N))e s( - Tv *W’ N ^ 


T(n N ) 


d 


E 

i =0 


X 


X 


< 


X 


( 27 r )( m - 1 )/2 


y/|detD 2 S(!ZV(iV),iV)| 

k 2 n m ~ 1 

h(Ny/ 2 ~ 3S d 

( 2 7 r )( m - 1 )/2 

where constant K 2 is given by 


< 


\g(Tv*(N))\e s ^ Tv *^’ N ) ^ e *s'(7V(W)i x 


i =0 


Ko = 1 + 


Klh(Np) / g—hi (x)+<7i(x)e(No)\Nn _|_ _^- ie -|si(x)+tri(®)e(JVo)|JV^ 


Hence we get the final result. 


(49) 


(50) 

□ 


5 Gaussian type integral approximation 


Theorem 3. For the function S with the maximum type a) on the domain Q! N con¬ 
taining the points \x — x*\ < h ^ N ^/ 2 -s but with the distances between points given by 
b\/N, b 2 /N ,..., b m /N for each direction in M m we have following estimate 


N 71 


3 (x-x* (N)) t D 2 S(x* (N ), N) (x-x' 


d 


'W) dx - J 2 


^x-x* (N)) T D 2 S(x*(N),N)(x-x* (TV)) 




< 


< 


N m h(N ) 


K 


d N h{N)( l/2-5)(m+l) ’ 


valid for N > N 0 , where K is some positive constant, S > 0 is an arbitrary small constant 
and d = jj n"=i k is a volume of the grid size. 

Proof. We start by dividing the domain, i.e. sphere of the radius h ^ N y_/ 2 s ; i n to m- 

dimensional hypercuboid, with edges of size ..., The hypercuboids are spread 

in the way that their middle points are the points of the lattice of the domain Q,^. 
Since Xi G {bi,bi/N,bi/N,... ,bi(N — 1 )/N, 1}, i = 1,..., m — 1 for the considered 
hypercuboids fit that purpose. Note, that some hypercuboids on the edge of the domain 
might not contain the point from Q' N as their middle point is outside the domain but the 
have middle point within larger Hjv- We write 


e {x-x*{N)) T D*S{x*{N),N){x-x*(N)) dx = 


'Tv 




e -\( x - x *(N)) T D 2 S(x*(N),N)(x-x*(N))\ dx 


(51) 

where oj is a single hypercuboid and we have minus and absolute value since D 2 S is 
negative definite for x G Qn Now, for each summand we apply first order Taylor theorem 
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at the middle point of the hypercube x w , i.e. 


e -\(x-x*(N)) T D 2 S(x*(N),N)(x-x*(N))\ dx = / J e -\(x u -x*(N)) T D 2 S(x*(N),N)(x u -x*(N))\ + 


+ (Xu - x f£> e -\(x-**m) T -D 2 S(x*(N),N)(x-x*(N))\ 


= x 0(u) 


dx, 


where xg( u ) is between x u and x and D is a differential operator along x. Then we divide 
the integral into two and integrate one with constant function and obtain 

f e -\{x-x*{N)) T D 2 S{x*(N),N){x-x*{N))\ dx = d c ~\(x„-x*(N)) T D 2 S(x*(N),N)(x„-x*(N))\ . 

N m 


+ / (X u ~ x ^ T D e -\^- xt ( N )) TD2 S(x*(N),N)(x-x*(N))\ 

J UJ 

and we put it back into (I5TT) and obtain 


dx, 


=xe(uj) 


d 


in' 


e -\(x-x*(N)) T D 2 S(x*(N),N)(x-x*(N))\ dx _ a c ~\(x„-x*(N)) T D 2 S(x*(N),N)( Xuj -x*(N))\ . 

Z —t J\frn 


Cj££l f KT 


(52) 






dx 


c 0(u/) 


We divide the first sum over all hypercuboid in above equation into one over those which 
middle points points are in tt' N and those which middle points are outside fl' N and denote 


this as 


y — 

jym 


-\(x u -x*(N)) T D 2 S(x*(N),N)(x u -x*(N))\ _ 


r 


N‘ 


1 e -\(x-x*(N)) T D 2 S(x*{N),N)(x-x*(N))\ ^ 


+ w~ E 

_/V m Z—/ 


-|Or-x*(AO) D 2 S(x*(JV),iV)(ir-:r*(iV))| 


x&n'. 


x£Q‘ 


N, 


Including that we can rewrite (l53|i into 


d 


in' 


e -\(x-x*(N)) T D 2 S(x*(N),N)(x-x*(N))\ dx = e ~\{x-x*(N)) T D 2 S(x*(N),N){x-x*(N))\ + 

N m Z^- 


x£n'. 


y f (xw- x) T De 
- n , Ju 


T r\ —\(x—x*(N)) T D 2 S(x*(N),N)(x—x*(N))\ 


L 

d 


dx+ 


= x e( ui) 


U \ "V 

TV m Z^ 


d -\(x-x*(N)) t D 2 S(x*{N),N)(x-x*(N))\ 


(53) 


xen 1 ; 


Then we perform some rearrangements and add absolute value on the both sides, apply 


23 







trinagle inequality 


,-\{x-x*(N)) T D 2 S{x*(N),N)(x-x 


in' 


*m\ dx _J_ y 

N m Z—/ 


0 —\(x—x*(N)) T D 2 S(x*(N),N)(x—x*(N))\ 


xGQ', t 


< 


s E 

i/e 

d 




_ ^T jDe -|(x- a; *(iV)rD 2 S( a; *(iV),iV)( 3: - ; r*(iV))| 


dx 


=®fl(w) 


+ 


TV 71 


E 


3 — |(a:-®* (N)) t D 2 S(x*(N),N){x-x* (N))\ 


(54) 




Then we estimate each of the two sums on the RHS of the above inequality. Since a; is a 
hypercuboid the edge sizes ..., for any x G lo we have that \x itU} — Xi\ < jfr, i — 

1,..., m— l,and therefore by equivalence of max norm \x u —x\ < max, \x i)U —Xi\ < max* 
Hence we can bound the integral over the hypecuboids ui in following way 


U _ x \T De -\(x-x*(N)) T D 2 S(x*(N),N)(x-x*(N))\ 

bm 


= x 8( ui) 


dx I 

I X — %Q(uj) 


< 


N 


/ max 

d ^—\(x—x*(N)) t D 2 S(x*(N),N)(x—x*(N))\ 


L * 

dxi 

x=x 8(u) 


dx < 

dx, (55) 


where max* bi = b and we bounded the sum of derivatives by m maximal derivatives. 
Then we calculate the derivative 


bm 

~N 


/ max 

d -\(x-x*(N)) T D 2 S(x*(N),N)(x-x*(N))\ 


L 7 

dxi 

x=x e(u) 


dx = 


bm 

~N 


max 

i 


d 2 S(xo(u),N) 
dx 2 


m— 1 


2( Xi ~x*(N))+ 


d 2 S(x0( UJ ),N) 


dxjdx; 


Xn 


x*m 


X 


X e -|(zfl(u,)-x* (N)) T D 2 S(x* (N),N)(x e(u) -x * (N))\ dx ^ 

then we bound the expression under the integral, noting that |xj — ;r*(iV)| < 
and calculate the integral itself 


(56) 


h(Ny/ 2 ~ s 


bm 

~N 


max 


d 2 S(x e{u}) ,N) 

dx 2 


m— 1 


2(xi-x\(N))+ V 


d 2 S(x e ^),N) 

dxjdxj 


.Xj - x’AN)) 


X 


X e -\(x e ^ ) -xyN)) T D 2 S(x*(N),N)(x e(ul) -x*(N))\ dx < 

< h ( N ) dhm K -\(x f>t: .,,-x*(N)) T D 2 S(x*(N),N)(x f>tl .,,-x*(N))\ 

~ N N m h(Ny/ 2 ~ s 


(57) 


where we used the fact that from the representation ([2]) is of order h(N). 

In order to get rid of dependence of above estimate on the particular hypercube we 
introduce estimates. Since D 2 S is negative definite, by Schwartz inequality, assumption 
(]4]) and the inequality form appendix (l80]i we have 


(xg H -x*(N)) T D 2 S(x e 2 {N) ,N)(x eH ^x*(N)) 


- \\D 2 S(x 0 2 {N) ,Ny\\ lXe ^ 


x*(N )| 2 < 0 


-|(aj«(w) - x*(N)) T D 2 S(xg 2{N) , N)(x e ^) - 


x*(N ))I < 
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where last inequality due to fact that \xg( w ) — x*(iV)| > 0 for x 6 Q' N . ffence we can write 
h(N) dbm K 


< 


N N m h(Ny/ 2 ~ s 
h(N ) dbm K 


D -\(xe( u )~=°*(N)y D*S(x*{N),N)(x g(u)] -x*{N)) < 


N N m h(Ny/ 2 ~ s ’ 


(58) 


We combine the estimtes ([55]) . (156|) . (l57j) and (1581) . then we put it into orginal sum over 
all hypercubes in (Hk? 1) and obtain 


Y I ( XuJ - x) T De^^ x *( N )) Tr>2s ( x *( N ), N )(x- x *( N ))\ 
h(N) 1 K’ 


dx < 


= x 0 (u) 


< 


N N m h(Ny / 2 ~ 5 


E* 


(59) 


Now we estimate the number of the hypercuboid oj. Note, that in the hypercube of the 
edge size h ^ N y /2 -s of dimension m there are contained HUi [ b h ^i/ 2 -s J hypercuboids. 
The exact number of hypercuboid is determined by the position of the hypercube with 
the edge h ^ N y_/ 2 -s on the grid of the hypercuboids. Some hypercuboids are contained 
partially. The total number of hypercuboids, those contained completely and partially 
can be bounded by adding extra hypercuboids. We add extra hypercuboid on each 
boundary and in each corner. Hence we have 


E^n 


2=1 


N 


-bih(Ny/ 2 - s 


-J+2 +2 m , 


where extra term inside the bracket corresponds to the boundary and the last term to 
the corners. We also can bound the x l i-h^N ) 1 / 2 - 6 J an d °htain 




E 1 ^ 


N 


h(Ny/ 2 ~ s b 


+ 2 + 2 r 


where max* bi = b. 

We combine above estimate with ([59]) and perform some simple calculations 


Y / ( Xu - x) T r>e~^ x ~ x * {N))TD2s{x * {N) ' N){x ~ x * {N)) 




dx < 


= x 6(w) 


< 


h(N) 


K’ 


N h(AT)(l/2-5)(m+l) 

Therefore, eventually we get 

Y f(x u - x) T De-\ {x - x * iN))TD2s{x * {N) ’ N X x - x * {N)) 


1 2/r(iV) 1 / 2_<5 \ m f2h(Ny/ 2 ~ 5 ^ m ' 

+ N ) + \ N 


/ J U 


dx < 


h{N ) 


IC 


= x e(u) 


valid for some N > A r 0 , where 


K" = K' 


b + 


2h(N 0 y' 2 

N n 


S\m 


+ 


(2h(N 0 y/ 2 

V ^0 


N h( iV) C 1 / 2 —<5)(rrj.+l) ’ 
(60) 

—S \ rri' 


25 
























For the second sum in the RHS of (154|) we use the fact that the points x € are su °h 
that \x — x*(iV)| > h ^ N yi/ 2 —s ■ Hence using Schwartz inequality and assumption (J4|) we get 
an estimate of the expression in the exponent 


- I(* - x-(N)) t D 2 S(x'(N), N)(x - x'(N)) < - 2g 1 |x - x'm 2 < 

< -h(N) 25 s' (2) , 


and we have an estimate of whole expression 


yy e -\(x-x*( n)) t d 2 s(x*(n),n)(x-x*(n))\ < e ~h(N) 2 S s'M ^ 


xGfl'f, 


xGfl'i 


Note that we consider only those x G 0”? that are middle points of the hypercuboids 
which are partially contained in the domain Q' N . However we make a crude estimate 
and bound this number of hypercuboids by a number of hypercuboids which contains 
the hypercube of edge size 1, which contains whole domain This number is N m . 
Therefore we have a final estimate of second sum 



e -\(x-x* (N)) t D 2 S(x* (N),N)(x-x* (JV))| < e -h(N) 25 s'd jym 


sen" 


( 61 ) 


Finally, we substitute estimates (16(71) and (16T1) into (154|) 


d 


e {x-x*{N)) T D 2 S{x*{N),N){x-x*{N)) dx _ e (x-x*{N)) T D 2 f{x*{N),N){x-x*{N)) 


sen'. 


< 


< 


h(N) 


K " 


N h(iV)( 1 / 2 -< 5 )( m + 1 ) 


+ e 


—h(N) 2S s'( 2 ^ jym 


We multiply whole expression by and perform some manipulations 


N 7r 


dx-x* (N)) T D 2 S(x* (N),N)(x-x* 


in' 


e . -.. ‘‘ m Ux- v e- 


(x-x* {N)Y D 2 f(x*(N),N)(x-x* (AT)) 


x&n' N 


< 


< 


N m h(N ) 


Ii" 


d N h(N)( Va-Wm+i) • 
where K'" is given by 

K'" = 1 + e 


-MWW N ° ^(^Vo) (1/2 ^ )(m+1) 


h(N 0 ) 


K"> 


valid for N > N 0 . 


□ 


6 Additional estimates 

Preposition 1. For the function S with maximum of typa a) and function S(x,N ) = 
S(x,N ) + \Jh(N)(x* — x) T f which has maximum at the point x*(N) we have following 
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results 


x*(N) — x*(N) 
S(x*{N),N) = 
S(x*{N),N) = 


= D 2 s ( x *)~ 1 
S(x*(N),N) 
S(x*(N),N) 


O 


h(N) J ’ 


VKN) 

- -i r D 2 s{x*)- 1 i + 0(1) , 1 

2 ^ 1 ; ^ 1 WW) 

- lfD 2 s{x*)-^ + 0(l)^h(Nje(N) 


Vdet D*S(x*(N),N) = i | ( 1 \ 

^ JdetD 2 S(x*(N),N ) \y/h(N)J 



(62) 

when e(N) -C 

1 

h{N) ’ 

when e(N) 

1 

h(NY 


(63) 


(64) 


as N —>• oo, where for all results we assumed that e(N) -C 

Proof. We begin with the proof of the first estimate. 

Let us take first order Taylors expansion of the vector function DS(x*(N),N ) at the 
point x*(N) 


yjW '.)' 


DS(x*(N ), TV) = DS(x*(N), N) - y/h(N)£ + D 2 S(x e (N), N) T (x*(N ) - x*(lV)). 


where xg(N) is somewhere between x*(N) and x*(N). 

Since x*(N) and x*(N ) are a critical points, of respectively S(x,N ) and S(x,N ) hence 
DS(x*(N), N) = DS(x*(N), N) = o, where x = o is a vector of origin. Furthermore 
as S G C 2 the order of differentiation does not matter we have that D 2 S(xo(N), N) T = 
D 2 S(xg(N), N). Hence following equality is valid 

D 2 f l (x 0 (N),N)(x*(N)-x*(N)) = y/h(N)t 


Then we take define a lower bound as in (l80]i and have a bound due to (J4]) and after 
small transformation obtain 


x*(N ) 


x*(N) < 


VW ) 


(65) 


Note that for different value of £ the point Xg(N) might be altered, but this does not 
influence the constant s as it is defined as a supremum over whole domain. 

Further, we use second order Taylors expansion of DS(x*(N),N) at x*(N) 


DS(x*(N ), N) =DS(x*{N ), N) - y/h(N)£ + D 2 S(x*(N ), N)(x*(N) - x*(N)) + 
+ D 3 S(x e (N))(x*(N ) - x*(N))® 2 


where xg(N) is some point between x*(N) and x*(N). Again, we have that DS(x*(N), N ) = 
DS(x*(N),N) = o. 

Now we transform above expansion and get the upper bound as in (j82j) bound it as in 
(151) and with some calculations obtain 


D 2 S(x*(N),N)(x*(N) -x*(N)) - y/h{N)£ 


o(3) 

< h(N)—\x*{N) 
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and then substitute estimate (165T) in the RHS and obtain 


D 2 S(x*(N),N)(x*(N) -x*(N)) - y/h(N)£ 


s ( 3 )( s '(2))-2|^| 

2 


Next we transform LHS of above inequality, bound the second derivative matrix and as 
a result obtain a lower bound of above 

(x*(N) - x*(N)) - D 2 S(x*(N), N)- 1 yJh(N)£ 

Next we apply Taylor’s theorem of the first order at x* to D 2 S(x*(N), N)^ 1 we get 
D 2 S(x*(N ), N)- 1 = D 2 S(x*, N)- 1 + D 2 S(x e (N ), N)~ 1 (x*{N) - x*). 
and then we transform it apply absolute values on both side and trinagle inequality 
\D 2 S(x*(N), iV) -1 — D 2 S(x*, iV) —1 1 < ||O 2 S(z 0 (iV),iV)- 1 |||:r*(iV) - x*\. 


< 


s ( 3 )( s ,( 2 ))- 3 |£| 

2 h(N) 


( 66 ) 


and again transform 
1 


h(N) 


\D S(xo(N), N) 


—1II—1| n2 < 


D S(x*(N), TV) — D S(x*, TV) | < 


h(N) 


\x*(N)-x* 


Finaly we use the property (jl]) and (J6]) and obtain 


| D 2 S(x*(N),N)~ 1 - D 2 S(x*,N)~ 1 \ < —— -(s' (2) )- 1 0(l)e(iV). (67) 

ri[l\) 

Now we perform some transformations on D 2 S(x*,N)~ 1 using (J7J) 

D 2 S(x',N)-' =-^[Dh^+aix-XN)}- 1 = ^Z) a s ( a: -)- I [/+ ff (i-) £ (JV)r> J S (a : > )]- 1 

where / is m ® m identity matrix. Now we apply the asymptotic version of second result 
of the Theorem 5 from the Appendix 


(I + eA) — / + 0(e), e —> 0, 


ffence we have that 


D 2 S(x\ AT 1 = j^DhixT' + 1 ^- ) Dh(xT 1 <’(x’)0(e(N))D 2 s (x') 
which can be simplified to 


since all the constants are contained in big ’O’. Then we substitute above estimate into 
(E7j) and after some calculations get 


D 2 S(x*(N),N)- 1 


h(N ) 


Wl ^ 0(1) - 


( 68 ) 
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and finally we substitute above into (1661) and after some manipulations obtain 




VKN) 


Now, since we assumed e(N) -C 


D 2 s(x*)~^ 


we have 


< s ( 3 V ( 2 ) )- 3 |g| , <N)\£\ 


2h(N) 


VW) 


VHN) 


(x*(N) - x*(N)) - 


VW) 


D 2 s(xT'Z 


< K 


h(N) ’ 


where K = - 3|g| + e(N 0 )^h(N 0 )\£,\O(l). 

Now we prove the second result of this preposition. 

We start by substituting the formula for x*(N) given by the first result of the preposition 
into the explicit expression for S(x*(N),N) given in the statement of the preposition 


S(x*(N), N) = S' x*(N) + D 2 s(x 


^2 —1 




VW) 

- v 7 h(N)f( x*(N) + D 2 s(x*) 


+ 0 
-i e 


h(N))’ N 

yyvy + °(mao) 


(69) 


Then expand the function S in RHS using 3-rd order Taylor expansion at the point x*(N ) 


Si x*(N) + D 2 s(x *)~ 1 


^ + o f 1 


VW) 


h(N) J ’ 


N 1 = 


S(x*(N), N ) + DS(x*(N), N ) ( D 2 s(x*) 


,*\-i 




VW) 


+ o 


h(N) 


1 


+ ^ ( D 2 s(x*)~ 1 


^ + o f 1 


VHN) 


h(N ) 


D 


2 S(x*(N), N) ( D 2 s(x*) 


+ 

* \—i ^ 




VW) 


+ o 


h(N) 


lD® 3 S(x dl (N),N)(D 2 s(x*) 


-l 


6 




VW) 


+ o 


h(N )) 


where x 9l (N) is some point between x*(N) and x*(N). Further, we substitute above in 
the previous equality (jS5j) an note that DS(x*(N), N) = o 


S(x*{N ), N) = S{x*(N), N ) - y/h(N)£ T (x*(N) + D 2 s(x*)- 1 ^S= + Q f 1 






VKN) 


+ o 


;D® 3 S(x 9l (N),N)( D 2 s{x 


h(N ) 
i > 


ZTS(x*(iV),iV) £> 2 s(x*) 


VKN) 

21 £ 




h(iV) 


+ 0 


— X 


h(N) 




^h{N) + °(h(7V)) 
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Next, we find the upper bound as in (1781) and additionally bound the constant due to (JSJ) 


S(x*(N), N) — S(x*(N), N) + y/h(N)£ T [x*{N) + D 2 s{x*)~ 1 

T 


£ 


+ 0 


--( D 2 s(x*'~ 1 


^ +0 1 


< -h(N)s^ 
6 


VW) 

21 £ 


D 2 s(x*y 


h(N) 


+ o 


D 2 S(x*(N),N)lD 2 s(x*) 


VW) 

( n2 —1 S 


h(iV)) ^ 


a/MA0 


+ o 


h(N) 

(70) 


Now use Taylors Theorem on D 2 S(x*(N),N ) at x* 

D 2 S(x*( 1V), iV) = D 2 S(x *, IV) + D® 3 S(x 0 (1V), 1V)(x*( 1V) - x*), 

and then we transform above estimate and bound the third derivative using (170)) and (JO]) 

\D 2 S(x*(N),N) -D 2 S(x*,N)\ < h(N)s {3) \x*(N) -x*\, 

and finally we use the estimate (JH)) and obtain 

D 2 S(x*(N ), N) = D 2 S(x*, N) + 0{l)h(N)e{N), (71) 

where the big ’O’ contains the constant s Next we by differentiation of the represen¬ 
tation © obtain other form of D 2 S(x *, N) 

D 2 S{x*,N ) = h(N)[D 2 s(x*) + Da(x*)e(N)}, N -y oo 

and substitute it into (TTTjl 

D 2 S(x*(N),N) = h(N)D 2 s(x*) + 0(l)h{N)e{N), 

where again we included constant in big ’O’. Finally we and we substitute it into (1701) 
together with the result (J6]) and perform some basic calculations 


S(x*(N), N ) - S(x*(N), N) + C D 2 s(x*)~ 1 Z + 

T 


1 


--( D 2 s(x^~ l 


i 


-\[ D 2 s(x*'- 1 


VW) 

i 


+ 0 


+ 0 


1 s® 

< -- 




VW) 

D 2 s(x*)~ 1 £ + 0 


h(N) 

1 

MAO 

i 


a/MA0 

h(N) D 2 s(x* (N)) ( D 2 s(x*) 


fO( 1) + ^h(Nje(N)fO( 1) 
-i e 




h(N)0(l)e(N) (D 2 s(x*)~ 1 ^ 1 




VKN) 

+ O 


+ 0 


VHN) 


h(N ) 




and perform further transformations, such as triangle and Schwarz inequalities and use 
of (1821) and others 


S(x*(N), N) - S(x*(N), N) + -eD 2 s(x*)~^ 


< 


< 


1 s ( 3 > 


6 a/MAO 


D 2 s{x*)- 1 £ + 0 




+ e(iV)|0(l)h 


D 2 s(x*)-^ + 0 


MV 




WnJ 


+ 


' |£||0(1)| + ^h(Nje(N)\fO(l)\ + —=b=|0(l)||€| + -T— 


VWj 




2h(N) 


< 


h(N)) 


< 
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Since we have restriction e(N) <C 




we can reargange above inequality into 


S(x*(N), N) - S(x*(N), N) + -fD 2 s(xT^ 


< 


< 


-s < 3 > 


VKN)l 6 

ieiio(i)i + |o(i)iiei + 


D 2 s{x*)- 1 £ + 0 


vm 


2 VW) 


|0(1)||£>M**)I 


* w ,(+ 0 { tn ) 


+ ^WHN)\o(i)\- 


+ 


and other cases of e(N) would result in the situation that second error therm would be 
infinite lub just non ze 

will have two subcases 


infinite lub just non zero. Further within the case e(N) -C J— the above inequality 

V H N ) 


S(x*(N), N) - S(x*(N), N) + -fD 2 s(xT^ 


< 




VW) 


when e(N) < 


1 


S(x*(N ), N) - S(x*(N), N) + -^D 2 s(x*)-^ 


< K 2 \/h(N)e(N) when e(N) 


h(NY 

1 

h(N) ’ 


with 


k i = b (3) 

o 


D 2 s(x*)~ t + O 


+ v / M«o)e(JVo)|0(l)|- 


vm 

|?||0(1)| + |0(1)||£| + —7===|0(l)||D 2 s(V)| + ft(iV„) £ (Af 0 )|? T O(l)|, 


D 2 s(x*)~^ + 0 


VN~o 


+ 


K, = 


-s^ 


h(N)e(N) [6 

ieiio(i)i + |o(i)iiei + 


2^h(No)' 

D 2 s(x*)~ 1 £ + 0 




2,/h{N) 


|0(l)||D^(x*)| 


+ ^h(N)e(N)\0(l)\- 

+ ie T o(i)i, 


D s (x*)~ £ + 


0 ( 1 ) 


Vn 


+ 


hence we get the second result. 

Finally, we now prove the Prepositions third result. First we take first order Taylor 
approximation of D 2 S(x*(N), N) at x*(N) 

D 2 S(x*(N), N ) = D 2 S(x*(N), N) + D® 3 S(xe(N), N)(x*(N) - x*{N), N ). 


Since D 2 S(x*(N), N) = D 2 S(x*(N), N) as the term -\/h(N)(x* — x) T C, vanish in the 
second derivatives of x. Then we bound it as in (l82j) and (l5i) 

\D 2 S(x*(N),N) - D 2 S(x*(N),N)\ < h(N)s^\x*{N) -x*(N)\. 

Next, we substitute the first estimate of this preposition, i.e. for x*(N) — x*(N) 

\D 2 S(x*(N),N) - D 2 S(x*(N),N)\ < v 7 h( K N)s^\D 2 s(x*)~ 1 C, + 0(l/y/h(N))\. 

Now we divide inequality by \D 2 S(x*(N), N) I and obtain 


D 2 S(x*(N), N) 


D 2 S(x*(N),N ) 


< Vhn) 


s^Mx^ + Ojl/VW))] 

\D 2 S(x*(N),N)\ 


(72) 
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Now we apply Taylors theorem of the first order at x* for the function in the denominator 
of RHS 

D 2 S(x*(N ), N) = D 2 S(x*, N ) + D 2 S(x e (N ), N)(x*(N) - x*) 

Then we transform above equality into 

\D 2 S(x*(N), N) — D 2 S(x*,N)\ < \\D 2 S(x 0 (N),N)\\(\2*(N) -x*(N)\ + \x*{N) - F|), 

and we bound the RHS using the first result of the Preposition and ©, © 

|F 2 R(F(1V),1V)-Z) 2 S(F,1V)| < ^h[N) [D 2 s{x*)~ l i+0{1/^l^)+^h(^e{N)\0{l)\]. 

Next we differentiate the representation ©, substitute it into above inequality and after 
some calculations obtain 

\D 2 S(x*(N), N) — h(N)D 2 s(x*)\ < ^/h{N) [D 2 s(xT^+0(l/V^)+VhW<N)(\0(l)\+a(x*))]. 
and finally due to fact e(N) -Cl/ y/h(N) we can get an estimate 

\D 2 S(x*(N), N)—h(N)D 2 s(x*)\ < ^hiN)[D 2 s(x*)-^+0(l/VHNo))+Vh(N 0 )e(N 0 )(\0(l)\+a(x*))]. 
therefore we have following estimate after appropriately applying the triangle inequality 
|(IV), IV)| > h(N)\D 2 s(x*)\ - I<\/h(N), 


where K\ is some positive constant. We substitute above into (1721) 


D 2 S(x*(N),N ) 


D 2 S(x*(N), N) 


< 


1 s^\D 2 Mx*)-^ + 0(l/VW))\ 

yjh(N ) \D 2 s(x*)\ — K/ y/h(N) 


hence the RHS can be bounded for some N > Nq 


< 


1 s^MxT^ + oq/VW))] 

y/h(N) \D 2 s{x*)\ - K/y/h(N) 
therefore we get that 

D 2 S(x*(N),N ) 


1 g ( 3 )|F 2 / ; (F)- 1 ^ + 0(l/ x /M^o))l 

y/KN) \D 2 s(x*)\ — K/ y/hjNo) 


D 2 S(x*(N), N) 
In a different form we can write above as 

D 2 S(x*(N),N) 
D 2 S(x*(N), N) 

where |er| < K'. 

Now we take following 


< 


K’ 


yfW) 


= / + 


a 


s/N' 


(73) 


^/det D 2 S(x*{N),N) 1 


./detFF'^b-l 

J det D 2 S(x*(N), N) 


V \D 2 S(x*(N),N)J 


(74) 


which is valid by the properties of the determinant. 

Further, the first order Taylor expansion of the function f(x) = yfx at 1 is 

yfx = 1 + (a) _1 ^ 2 (a; — 1) 
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where a £ (x, 1). We apply above expansion to (f74|) with 




\D 2 S(x*(N),N ) 


and obtain 


/ f D 2 S(x*(N), N) \ _ 

V£ 2 S(T*(iV),A0 


where a £ (min(x, 1),max(x, 1)). 

From Theorem 4 from Appendix we have that 


det 


/ D 2 S(x*(N), N) 


\D 2 S(x*(N),N) 


- 1 


det ( I + 


cr 

y/N 


- 1 - 


tr(n) 


y/N 


< 


K" 

~N 


for some positive K". This can be transformed into 


det I / H-l — 1 


with 


y/N ) 


K'" = | tr(cr) | + 


< 


K'" 


Ks 

Nn 


(75) 


Hence, taking into account (j73j) and combining (f74|) . (175]) with above inequality one gets 


-y/det D 2 S(x*(N), N) 


- 1 


det D 2 S(x*(N),N) 


< 


K" 


y/h(N)c 


which is the third result. 


□ 


A Analysis 


Theorem 4 (Taylor’s expansion). Suppose that f is a real function on the nontrivial 
convex closed set A £ R m , n is a positive integer, f(n — 1) is continuous on A, f^ n \t) 
exists for every t £ A. Then there exists a point xg between x* and x, such that 


f(x)=f{x*) + ^2y dx . \ x , foi ~ 0(^2 -<)••• (Xi k ~ X* k ) + 

k =1 ’ j*fc=l n * 2 ‘ ‘ ‘ lk 


(76) 


n\ 


E 


d m f(xg ) 




dx,y dXj n . . . dXi 


{x h - X* h )(x i2 -X* 2 )... ( x im -X*J, 


where xg can be represented, xg = x* + 6{x — x*), 0 < 6 < 1 
The k — th in the Taylor’s theorem can be represented 
f k (x) 


y - 

,Cl= X dxi ' dx » ■ ■ ■ 


dx ik [Xil 


<) • • • fa* ~ O = D k f(x)(x - x*)® k , 


(77) 
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where <g) is tensor product, D : / —>■ V/ differentiation operator and D®D®.. ,®D = D® k 
and D® k f(x)\ x=Xe = D® k f(xg ) is an operater such that D® k f(xg) : W nk —>• M. 

Hence, for n > 4 expansion (USD can also be represented as 

/(x) —f{x*) + Df(x*) T (x — x*) + (a: — x*) T D 2 f(x*)(x — £*) + 

1 i i 

+ V T,D 0k f(x*)ix - x*)® k + —D® n f(x e )(x - x*)® n , 
k\ nl 

k =3 

where 0 < 9 < 1. 

Since operator D® n f(xg) is finite dimensional, hence it is bounded and we have 


Were we define 


\D® n f(x e )(x - x*)® n \ < \\D® n f(x g )\\\(x - x*)® n \. 


(78) 


which is a norm of the operator. Further, by the definition of the tensor product we have 
that 

< x <g) x, x <g) x >=< x, x >< x, x > 

which implies = \x\ k . Putting that fact together with (17H|) we get that n-th term in 
Taylor’s Theorem is bounded by 


\D® n f(x 9 )(x - x*)® n \ < \\D® n f{x e )\\\x-x*\ n . 

If the operator D® k f(x) is invertible, then we have x = D® k f( y x)~ 1 y and define 

, ln2 ,7 w„ \D® k f(;x)- l y\ 

II D f(x) || = sup-p-j- 

y&B \y\ 

where B is a range of the considered operator. Then we have inequality 


(79) 


D m f(x)- l y I < ||£> 2 /(i) 


-1 


which we transform taking into account relation x = D® k f{x ) 1 y 

||CVM-‘II W - \ DetfMx \' 

setting x = {x — x*)® k and including |(x — a;*) lS)fc | = \x — x*\ k we get 


\x — x 


*l^<\D® k f(x e )(x-x*)® k \, 


II D 2 f{x 

which is a lower bound for n-th term in the Taylor expansion. 
Analogically to Theorem 1 we can define following Taylor’s expansion 


(80) 


df(x) _df(x*) £ 


d k+1 f{ 


X 


dxi 


dxj 


k\ 

k =1 


dxj dx n dx l2 ... dx 


' l k 


( x h - xi)(x i2 -X* 2 )... (. x ik -x* k ) + 

(81) 


1 

n! 


E 


d m+1 f(x e ) 


. dxjdxi*dxi 0 ... dxi 

2l,Z2,.-,ln = l J 
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where xg is somewhere between x and x*. The vector composed of elements of above 
expansion for j = 1,... , m can be defined as 

n-l 

Df(x) = Df(x*) + D 2 f(x*)(x -x*) + Y -D^ k+l) f(x*)(x - x*)® k + -£>® (n+1) f(x 0 )(x - x*)® n , 

z —■' k\ nl 

k =2 

where we define operator £)®( fc+1 ) f( x ) : —» M m for k > 1 as 


[D^ k+ ^ f (x)(x-x*r k } j = y 


d k+1 f{ 


x 


Xi 


1 dx 3 dx n dx l2 ... dx ik v ~ n 


x*Mx 


*2 ^12) 


\ Xi k -x ik ), 


for j = 1,..., m. 

Analogically to the bounds of the remainder of the previous Taylor’s expansion (1791) and 
(1801) we have for D®( k+1 ^ f(x) 

\D^ k+1) f(x e )(x - x*)® k \ < \\D^ k+1) f(x e )\\\x-x*\ k . (82) 

Moreover, if D®^ k+1 ^ f (x) is invertible we have 

iiJr + 7 ) ;X)-i| A^ +i) /fa ) (^-vn. 

Further, we dehne another Taylor’s expansion, analogical to one in Theorem 1 as 


n— 1 


d 2 f(x) d 2 f(x*) , >rA j_ y- 

^ k\ ^ 


d k+2 f(x*) 


dxjdxi dxjdxi 


dxjdxidxi,dx i2 ... dx 


(xh ~ x* )(x i2 -<)..• {x ik -x*)+ 


— y 

nl ^ 


iv. . 

k =1 Zl,22,...,lfe=l J 

d m+2 f(x e ) 


^k 


(83) 


il,i2,...,in=l 


dxjdxidxi.dxi 2 ... dx 


(x h - x*Mx i2 (x im -x*J, 


where again, xg is somewhere between x and x*. The matrix composed of elements of 
above expansion for j — 1,..., m, l — 1,... ,m can be defined as 

71-1 

D 2 f(x) = D 2 f(x*) + ^ -D 0ik+2) f(x*)(x - x*) 0k + -D^ n+2) f(x e )(x - x*f n , 

k =1 

where we define D®^ k+ ^f(x) : IT 1 " M™ 2 for k > 1 as 


[D®^f(x)(x-x*) 0k ] jtl 


™ 9 fc+2 /(a:) 

. “ dxjdxidx^dxi 2 ... dx ik 


\x. 


1k 


-x 


^k 


J 


for j — 1, ..., m, l — 1, ... ,m. 

Then again we have that 

\D®( n +Vf(xg){x - X*)® n \ < \\D®( n+ Vf(xg){x - x*)® n \\\x - X*\ n , 
and if D®( n+ ^ f(x e )(x - x*)® n is invertible we have 


x — X 


\\D®( n+2 ')f(xo)(x — a:*) l8in | 


< \D®( n+ Vf(xg)(x-X*)® n \, 


where n > 1. 
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Lemma 4. For any N > 0, the integral 


e -N X TAx dx= ( 2 " 


l?n/2 


,N~~ 


y/\ det A\ 

where A is a symmetric negative definite m — 1-dimensional matrix 
Proof. Standard calculus result. 


(84) 


□ 


Lemma 5. For some constant N > 0 and (m — 1)-dimensional sphere with radius R 
denoted by S m -i(R), with center in the origin, the integral 


e NxTAx dx < 


n 2 _ e ~NR 2 


1 /1 + Vl + 4 R 2 

L4V V 2 


m— 1 


JM. rn \s m (R) y/\ det A\ r(f) 

where A is a symmetric negative definite m — 1-dimensional matrix. 

Proof. Since A is negative definite we have 

f e Nx T Ax dx= f e - N \x T Ax\ dx 

J«.™\Sm{R) JR m \Sm.(R) 

We start we performing the change of variables x = '/Ax' and we get 

1 


+ 


r(m) 

N m ~ 1 


(85) 


e ~ N \x Ax\ dx = . _ 

% \S m -i(R) a/I det A\ jRm\Sm(R) 


e~ Nlxl dx. 


( 86 ) 


Then we change the coordinate system into spherical one where x' = rs r , and radius 


r = \x 


'\S m (R) 


r N w 2 d y = 


e Nr2 ds r dr 


' R JS m {r) 


As the function under the integral does not depend on the surface coordinates we can 
independently integrate over the surface. The surface of sphere in m — 1-dimensional 
space of radius r is given by 


S m (r) = 2 


7T 2 


„m— 2 


and then 


r( 

e~ Nr "ds r dr = 2 


t) Jr 


Jr JSm(r) r( 

Now we perform a substitution t = N(r 2 — R 2 ) and get 


ilL /»00 

I r 'm— 1 g—Vr 2 dr . 


'.m-lg-JVr 2 ^ = e -NR 2 


'R 


m — 1 

11 t 2 \ 2 dt 

e 1 n + r ) 2F 


(87) 


For t > 0 we have following estimate 




771— 1 / j_ \ 771—1 

+ ' iV 
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where K is some positive constant. We substitute above into (187|) and get 


r»00 


POO 


I r m ~ 1 e~ Nr2 dr < e~ NR2 I e 
'R Jo 


,/! +Vl + 4 R 2 


4+ fWir‘4. 


2N 


N 


2N 


Then after calculating explicitely the first integral and noting that gamma integral rep¬ 
resentation of gamma function is 


T(z) = / 

Jo 


we obtain 


r r m - l e~ Nr2 dr < e ~ NR2 — f 1 + Vl + ^ 

Ir 2iV \ 2 


771—1 


Now we put above together with (1X|) . (l86lh (lA|i 

1 


e NxTAx dx < 


Jvi™\Sm(R) \/\ det A\ r(f) 

hence we get the final result. 


m— 1 

71 2 e ~NR 2 


+ e -'** 2 4-r(m) 

2 N m y 


1 /1 + VI+ 4 R 2 \ m ~ l r(m - 1) 
iV V 2 / + N™ 


□ 


Lemma 6. For some positive a and an integer m we have following estimate valid for 
all t > 0 


(f + o)’"/ 2 < ( W1+4a i + «"* 


( 88 ) 


Proof. Let us calculate the points of intersection of functions (t + a) m ^ and t m . For this 
we have to solve 

(t + a) m/2 = t m , 

and this is equivalent to quadratic equation 


t 2 — t — a = 0, 


which has two roots 


1 4 \/l 4 4 a 1 — \/l 4 4 a 

4 = --j 4 = — 


2 2 

and since a > 0 second root t 2 < 0. We consider t > 0 and as both functions are strictly 
increasing for t <t\ function (t + a ) m / 2 is bigger than t m and for y > y\ other way round, 
ffence by adding to the function t m a constant (ti) m we obtain situation when it is bigger 
than (t 4 a) m//2 for all t > 0. □ 


Theorem 5 (Matrix series). For the matrix A e 


we have following exapnsions 


A A 2 A 3 

e — 1 4 A 4 —r 4 —r 4 • • • • 
2! 3! 

(/ 4 Ay 1 = 1 — A +A 2 — A 3 + 

A 2 A 3 

log(/ + A) — A 2 _ + _ 3 — ■■■’ 


(89) 

(90) 

(91) 


where for the last two series we have conditions that 


< 1. 
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we have following 


Theorem 6 (Determinant approximation). For a matrix A E M mxm 
approximation 


det 



1 + 


tr(A) 

N 



as N —> oo. 


Proof. From the Jacobi formula we have that 


det 



exp(tr(log 



(92) 


(93) 


for any A. 

From the expansion of the logarithm and exponential of a matrix form previous thereom 
we have that 


A_ 

e N 


log 



1 + v +0 


1 

iV2 


when N —> oo. Substituting above asymptotic equations into (FJJl) we get 

det ( / + v) =1 + tr (v + 0 (i^)) +0 (v5)’ (94) 


for N —> oo. 

Since trace is a linear transformation above is equal to the equation from the theorem. □ 


B Asymptotic theory and approximation 

Let / : A —> M be a continuous function and A = (a, oo) for some a. 

Definition 1 (Big O). The function f is of order O of the function g : A —as x —>oo 
if there exists is a constant K > 0 and xk G A such that for all x > xk 

\f(x)\ < K\g(x )|, 


and we write it symbolically 


f(x) = 0(g(x)), x-^oo. 

Definition 2 (Small o). The function f is of order o of the function g : A —>■ R as 
x —y oo if for all K > 0 there exists xk G A such that for all x > xk 

1 / 0*01 < K \a(x)\, 

and we write it symbolically 

f 0*0 = o(g (x)), x oo. 
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Lemma 7. Given inequalities 


Ai - Bi = C h i — 1,... ,m, 


(95) 

(96) 


where m G N following inequalities holds 

m m m m— 1 j m 

n^-n«-=nd+E e n n 

i= 1 i= 1 i=l j = l ( yn-jj k=l l=j +1 

Proof. We start by introducing equality 

m mm 

Y[A i = {A 1 -B 1 )JlA i + B 1 JlA i , 

i— 1 z=2 z=2 

which we obtained by adding and deducting i?i n™ i ^. 

Then again, we add and deduce, but this time B\B 2 n;=s ^ and (^i - B i) B 2 iYiu A i 
and get 

771 771 771 771 777 

A* = (Ai — i? 1 )(A 2 —-B 2 ) J^[dLi + (7Li — Bi)B 2 Aj + i? 1 ( J 42 —-B 2 ) A + -B 1 -B 2 

7=1 7=3 7=3 7=3 7=3 

We repeat that step until all Aj’s in the products are replaced by (A t — Bf), which 
eventually leads to the equation 

771 777 777 777—1 j 777 

n a > - n b ‘ =if- 4 * - ^+e e nn ^ - b ^ b - ^ 

i =1 i =1 i=l j = 1 Qm—i,j k=l l=j +1 

where Y2c m ~ j ’j is a sum over possible arrangements of the elements of the set {1, 2,..., m} 
into two groups, where elements does not repeat and within the group the order does 
not matter. First group is of the size m — j and second j and their elements correspond, 
respectively, to the indecies ik, k — 1, ..., m — j and ii, l — m — j + 1 ..., m. 

Then we substitute (1931) and obtain 

777 777 777 777—1 j 777 

n*-n*=n«+E e n n 

i= 1 i =1 i =1 j =1 (f 1 - 3,3 k =1 l=j +1 

which is our result. □ 

Lemma 8. Given equalities 

A 1 ~B 1 = (t 1 , (98) 

A 2 — B 2 — cr 2 , (99) 


where cri,cr 2 G M are some constants, following equality holds 

A\ _ B± _ Bia 2 ai 

A 2 B 2 B 2 (B 2 o' 2 ) B 2 + cr 2 
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Proof. First we divide (l98]i by (l99|i and get 


Ai B\ + cr i 

A-2 B 2 — <7 2 


( 100 ) 


and then we transform LHS 


B\ + Q\ _ B 1 o~i 

B 2 + o 2 B 2 + o 2 B 2 + a 2 ’ 


then add and deduce B1/B2 and perform some manipulations 

Bi <71 B\ Bi Bi cr 1 

- - -1- - — = — -\ - - -- H- - — = 

B ‘2 + CT2 B2 + <72 B 2 B2 + (72 B2 B2 + CT 2 

_B\ BiB 2 _ Bi{B 2 + 02) ( 7 \ 

B2 B2(B2 + cr 2 ) i? 2 (-B2 + cr 2 ) i ? 2 + <t 2 
_ Bi _ B 1(72 ( 7 l 

B 2 5 2 (i ? 2 + cr 2 ) i ? 2 + cr 2 ’ 

and then we put it back to (HOOF change the side of B1/B2 and obtain final result 

_ Bi _ Bi &2 < 7 \ 

A2 B2 B 2 (B 2 + cr 2 ) B2 + cr 2 

□ 
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